-- Logs begin at Wed 2021-06-02 16:02:34 UTC, end at Wed 2021-06-02 16:56:12 UTC. --
Jun 02 16:31:39.420683 dv-cinder-794021-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 02 16:31:40.414379 dv-cinder-794021-2-iscsi neutron-server[98172]: Beware of the coming changes in the project packaging
Jun 02 16:31:40.415076 dv-cinder-794021-2-iscsi neutron-server[98172]: https://github.com/svinota/pyroute2/discussions/786
Jun 02 16:31:41.884152 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.common.config [-] Logging enabled!
Jun 02 16:31:41.884872 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev251
Jun 02 16:31:41.885006 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98172) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 02 16:31:41.888331 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.common.config [-] Logging enabled!
Jun 02 16:31:41.888587 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev251
Jun 02 16:31:41.888894 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98172) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 02 16:31:41.889892 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 02 16:31:41.890125 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 02 16:31:41.890523 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 02 16:31:41.890768 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 02 16:31:41.891028 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 02 16:31:41.891305 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.891614 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.891972 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.892187 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.892484 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.892774 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.893083 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.893375 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.893701 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.893990 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.894252 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.894541 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.894771 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.895053 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.895341 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.895627 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.895849 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] debug                          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.896118 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.896548 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.896972 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.897254 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.897548 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.897852 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.898137 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.898410 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.898689 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.899036 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] host                           = dv-cinder-794021-2-iscsi {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.899312 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.899606 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.899878 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.900166 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.900431 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.900706 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.901000 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.901261 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.901534 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.901834 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.902120 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.902404 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.902703 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.902928 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.903140 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.903420 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.903703 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.903974 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.904247 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.904519 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.904791 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.905063 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.905326 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.905631 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.905906 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.906187 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.906460 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.906733 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.906999 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.907267 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.907561 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.907832 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.908098 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.908367 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.908735 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.909005 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.909275 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.909577 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.909885 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.910170 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.910443 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.910717 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.910997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.911261 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.911528 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.911796 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.912064 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.912329 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.912609 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.912878 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.913148 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.913419 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.913713 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.914001 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:41.914296 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.914594 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.914895 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.915177 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.915468 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.915744 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.916030 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.916305 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.916591 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.916875 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.917162 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.917437 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.917753 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.918027 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.918321 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.918619 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.918910 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.919198 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.919470 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.919739 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.920007 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.920280 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.920567 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.920859 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.921145 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.921418 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.921725 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.922015 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.922292 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.922562 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.922836 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.923122 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.923397 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.923668 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.923951 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.924271 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.924540 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.924806 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.925082 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.925361 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.925657 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.925926 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.926196 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.926470 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.926740 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.927021 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.927301 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.927579 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.927847 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.928115 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.928384 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.928652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.928928 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.929197 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.929469 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.929762 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.930035 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.930298 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.930565 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.930834 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.931101 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.931373 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.931647 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.931911 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.932180 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.932450 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.932718 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.932987 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.933276 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.933572 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.933872 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.934127 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.934412 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.934686 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.934957 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.935230 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.935502 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.935774 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.936039 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.936331 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.936610 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.936893 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.937173 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.937457 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.937769 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.938041 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.938319 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.938592 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.938861 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.939152 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.939437 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.939721 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.940083 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.940373 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.940664 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.940957 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.941237 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.941550 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.941853 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:41.942069 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 02 16:31:41.942318 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98172) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 02 16:31:42.308661 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:31:42.309046 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:31:42.309422 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:31:42.309875 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 02 16:31:42.721988 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.722208 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.722408 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.723746 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.724013 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.724284 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.760151 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.760432 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.760650 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.775011 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.775298 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.775717 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.813472 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.813760 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.814064 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.852891 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.853156 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:42.853396 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.092538 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f9b7d8ff9d0> agent after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.093192 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f9b7d8ff9d0> agent after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.093192 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f9b7d72a4c0> segment precommit_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.093376 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f9b7d72a790> network precommit_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.094227 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f9b7d73a940> segment before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.224136 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> network before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.224420 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f9b7d70bf70> agent before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.224725 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> network before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.224998 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.225262 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.225575 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> segment precommit_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.225859 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> segment precommit_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.226104 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> segment after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.226352 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> segment after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.226627 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> network after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.226878 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> network precommit_delete 0 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.227121 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port provisioning_complete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.227366 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.227627 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.227885 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> agent after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.228147 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> subnet after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.228404 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> subnet precommit_delete 0 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.228669 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.228913 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.229189 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> segment_host_mapping after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.229910 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.230171 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.230395 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> port after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.230674 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.230917 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.231156 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f9b7e186880>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.231561 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.231793 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.232023 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.232250 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.232476 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.232701 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.233066 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 02 16:31:43.236559 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 02 16:31:43.240573 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 02 16:31:43.244549 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(650, 699)])])
Jun 02 16:31:43.246430 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 02 16:31:43.246885 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 02 16:31:43.247221 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 02 16:31:43.247602 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 02 16:31:43.250487 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 02 16:31:43.250742 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 02 16:31:43.251089 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 02 16:31:43.278736 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 02 16:31:43.279243 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f9b7d8169a0>> qos_plugin after_init 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.279569 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98172) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 02 16:31:43.279980 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f9b7d8165e0>> logging-plugin after_init 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.281567 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98172) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 02 16:31:43.281932 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 02 16:31:43.282189 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 02 16:31:43.286163 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f9b7d6ba400>> floatingip before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.286511 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f9b7d6ba400>> port before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.350070 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 02 16:31:43.350320 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 02 16:31:43.350605 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 02 16:31:43.351060 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 02 16:31:43.385542 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_db.sqlalchemy.engines [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 02 16:31:43.723793 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing driver for type 'gre'
Jun 02 16:31:43.724343 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] gre ID ranges: [(1, 1000)]
Jun 02 16:31:43.782690 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing driver for type 'local'
Jun 02 16:31:43.783068 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing driver for type 'vlan'
Jun 02 16:31:43.797230 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] VlanTypeDriver initialization complete
Jun 02 16:31:43.797561 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing driver for type 'vxlan'
Jun 02 16:31:43.798125 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] vxlan ID ranges: [(1, 1000)]
Jun 02 16:31:43.859385 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing extension driver 'port_security'
Jun 02 16:31:43.859787 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.extensions.port_security [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] PortSecurityExtensionDriver initialization complete
Jun 02 16:31:43.860163 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing mechanism driver 'openvswitch'
Jun 02 16:31:43.860700 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing mechanism driver 'hyperv'
Jun 02 16:31:43.874597 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.plugins.ml2.plugin [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98172) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:31:43.875534 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3760>> port after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.876019 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3760>> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.876445 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3760>> port after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.876920 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3910>> subnet after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.877384 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3910>> subnet after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.877850 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d9e3910>> subnet after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.878341 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211580>> network after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.878769 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211580>> network after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.879187 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211580>> network after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.879669 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d2117f0>> security_group after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.880099 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d2117f0>> security_group after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.880516 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d2117f0>> security_group after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.880974 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211a60>> security_group_rule after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.881392 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211a60>> security_group_rule after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.881842 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211a60>> security_group_rule after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.882317 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211cd0>> address_group after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.882892 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211cd0>> address_group after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.883295 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f9b7d211cd0>> address_group after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.883708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] ML2 OVO RPC backend initialized. {{(pid=98172) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 02 16:31:43.884552 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> router_interface after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.884975 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> router_interface after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.885511 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> network before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.885966 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> networks before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.886416 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> port before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.886831 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> ports before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.887259 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> subnet before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.887675 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> subnets before_response 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.888099 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> network after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.888517 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> network after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.888931 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> network after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.889348 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> port after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.889830 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.890242 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> port after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.890652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> subnet after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.891074 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> subnet after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.891485 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f9b7d217100>> subnet after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.892205 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.plugin [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Modular L2 Plugin initialization complete
Jun 02 16:31:43.892610 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading services supported by the core plugin {{(pid=98172) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 02 16:31:43.893201 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.plugins.ml2.managers [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Got port-security extension from driver 'port_security'
Jun 02 16:31:43.893815 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.extensions.vlantransparent [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Disabled vlantransparent extension.
Jun 02 16:31:43.894402 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98172) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 02 16:31:43.894803 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: router
Jun 02 16:31:43.933696 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router_interface before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.934075 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_create 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.934436 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router before_create 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.934803 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router_interface before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.935157 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router_interface after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.935498 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_delete 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.935839 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> floatingip after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.936189 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_create 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.936541 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.936878 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.937208 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router_gateway after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.937549 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.937984 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.938345 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f9b7d877ca0> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.938679 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f9b7d877b80> port after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.939003 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f9b7d877c10> subnet after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.939331 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f9b7d877d30> subnetpool_address_scope after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.939666 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> port precommit_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.940066 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_create 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.940395 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f9b7d85f5e0> port before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.940725 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.941069 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router after_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.941399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_delete 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.941771 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_create 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.942121 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router_interface after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.942444 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> router precommit_update 55549900 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.942809 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f9b7d217220>> network after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.943784 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Tracking information for resource: router configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.944105 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Tracking information for resource: floatingip configured {{(pid=98172) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 02 16:31:43.949707 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.db.l3_agentschedulers_db [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 02 16:31:43.950297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f9b7d1cc040> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.950655 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f9b7d1c5ee0> port after_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.950994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _notify_port_delete at 0x7f9b7d1c5f70> port after_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.951335 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f9b7d1cc310> port after_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.952150 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f9b7d1eca00>> router before_create 55550100 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.952511 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f9b7d1eca00>> router precommit_delete 55550100 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.952866 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f9b7d1eca00>> router precommit_create 55550100 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.953212 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f9b7d1eca00>> router precommit_update 55550100 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.957942 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.provider_configuration [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service providers = [] {{(pid=98172) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 02 16:31:43.958300 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.db.servicetype_db [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98172) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 02 16:31:43.961626 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.service_base [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98172) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 02 16:31:43.961990 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.service_base [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98172) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 02 16:31:43.962325 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.service_base [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98172) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 02 16:31:43.963216 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.services.service_base [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98172) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 02 16:31:43.963694 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.services.service_base [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 02 16:31:43.964094 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:43.964428 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 02 16:31:43.975797 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:43.976066 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: auto_allocate
Jun 02 16:31:43.982689 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f9b7d196700> network precommit_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.983052 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f9b7d196700> network precommit_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:43.983600 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:43.983908 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: tag
Jun 02 16:31:43.991404 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:43.991723 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: timestamp
Jun 02 16:31:43.995791 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:43.996140 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: network_ip_availability
Jun 02 16:31:44.001769 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d18cf10>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.002140 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d18cf10>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.002563 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d18cf10>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.003359 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:44.003674 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: flavors
Jun 02 16:31:44.009265 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:44.009584 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading Plugin: revisions
Jun 02 16:31:44.014389 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98172) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 02 16:31:44.014783 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.705s {{(pid=98172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:31:44.015555 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98172) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 02 16:31:44.015884 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Initializing extension manager.
Jun 02 16:31:44.016388 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: __init__.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.016741 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: __pycache__ {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.017071 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.017400 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: address_group.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.018282 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.018886 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: address-group
Jun 02 16:31:44.019203 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: address_scope.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.019902 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.020393 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: address-scope
Jun 02 16:31:44.020715 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: admin_state_down_before_update.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.021708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.022232 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: router-admin-state-down-before-update
Jun 02 16:31:44.022539 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: agent.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.023216 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.023725 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: agent
Jun 02 16:31:44.024034 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: agent_resources_synced.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.024933 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.025429 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: agent-resources-synced
Jun 02 16:31:44.025788 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: allowedaddresspairs.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.027624 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.028129 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: allowed-address-pairs
Jun 02 16:31:44.028456 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: auto_allocated_topology.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.029549 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.030103 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: auto-allocated-topology
Jun 02 16:31:44.030423 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: availability_zone.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.031110 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.031607 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: availability_zone
Jun 02 16:31:44.031923 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: availability_zone_filter.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.032829 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.033345 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: availability_zone_filter
Jun 02 16:31:44.033772 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: data_plane_status.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.034674 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.035176 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension data-plane-status not supported by any of loaded plugins
Jun 02 16:31:44.035490 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: default_subnetpools.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.036375 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.036891 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: default-subnetpools
Jun 02 16:31:44.037199 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: dhcpagentscheduler.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.038063 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.038564 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: dhcp_agent_scheduler
Jun 02 16:31:44.038863 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: dns.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.039793 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.040293 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension dns-integration not supported by any of loaded plugins
Jun 02 16:31:44.040609 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: dns_domain_ports.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.041486 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.042024 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 02 16:31:44.042328 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: dvr.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.042992 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.043494 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: dvr
Jun 02 16:31:44.043796 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: empty_string_filtering.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.044692 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.045190 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: empty-string-filtering
Jun 02 16:31:44.045503 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.046439 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.046942 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 02 16:31:44.047242 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.048124 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.048619 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 02 16:31:44.048951 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: external_net.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.049876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.050381 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: external-net
Jun 02 16:31:44.050691 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: extra_dhcp_opt.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.051573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.052075 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: extra_dhcp_opt
Jun 02 16:31:44.052392 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: extraroute.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.053264 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.053791 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: extraroute
Jun 02 16:31:44.054109 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: extraroute_atomic.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.055142 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.055644 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: extraroute-atomic
Jun 02 16:31:44.055958 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: filter_validation.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.056858 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.057358 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: filter-validation
Jun 02 16:31:44.057702 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: fip_pf_description.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.058601 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.059102 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 02 16:31:44.059411 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: fip_port_details.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.060297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.060793 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: fip-port-details
Jun 02 16:31:44.061100 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: flavors.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.062393 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.062904 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: flavors
Jun 02 16:31:44.063218 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.065005 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.065597 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 02 16:31:44.065953 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: floatingip_pools.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.066650 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.067170 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: floatingip-pools
Jun 02 16:31:44.067593 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: ip_allocation.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.068522 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.069089 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension ip_allocation not supported by any of loaded plugins
Jun 02 16:31:44.069364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.070845 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.070845 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: ip-substring-filtering
Jun 02 16:31:44.071134 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l2_adjacency.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.072006 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.072552 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 02 16:31:44.072825 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.073871 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.074396 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: router
Jun 02 16:31:44.074712 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3_conntrack_helper.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.077100 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.077666 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 02 16:31:44.077994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.078916 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.079431 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: ext-gw-mode
Jun 02 16:31:44.079749 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.080721 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.081230 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: l3-ha
Jun 02 16:31:44.081545 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3_flavors.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.082466 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.082977 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: l3-flavors
Jun 02 16:31:44.083292 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.084197 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.084700 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 02 16:31:44.085012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: l3agentscheduler.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.086144 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.086652 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: l3_agent_scheduler
Jun 02 16:31:44.086970 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: logging.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.088514 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.089074 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension logging not supported by any of loaded plugins
Jun 02 16:31:44.089381 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: metering.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.090100 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.090674 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: metering
Jun 02 16:31:44.090990 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.092290 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.092780 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: metering_source_and_destination_fields
Jun 02 16:31:44.093339 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: multiprovidernet.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.094121 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.094635 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: multi-provider
Jun 02 16:31:44.094947 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: netmtu.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.095856 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.096431 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: net-mtu
Jun 02 16:31:44.096741 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: netmtu_writable.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.097662 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.098168 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: net-mtu-writable
Jun 02 16:31:44.098477 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: network_availability_zone.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.099130 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.099628 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: network_availability_zone
Jun 02 16:31:44.099971 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: network_ip_availability.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.101051 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.101552 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: network-ip-availability
Jun 02 16:31:44.101896 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: network_segment_range.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.102725 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.103162 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension network-segment-range not supported by any of loaded plugins
Jun 02 16:31:44.103469 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: pagination.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.104780 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.105117 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: pagination
Jun 02 16:31:44.105429 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: port_device_profile.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.106325 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.106835 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: port-device-profile
Jun 02 16:31:44.107152 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.108035 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.109134 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: port-mac-address-regenerate
Jun 02 16:31:44.110538 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.111441 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.111995 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: port-numa-affinity-policy
Jun 02 16:31:44.112307 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: port_resource_request.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.113199 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.113746 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension port-resource-request not supported by any of loaded plugins
Jun 02 16:31:44.114057 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: portbindings.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.114942 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.115454 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: binding
Jun 02 16:31:44.115770 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: portbindings_extended.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.117065 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.117576 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: binding-extended
Jun 02 16:31:44.117932 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: portsecurity.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.118833 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.119347 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: port-security
Jun 02 16:31:44.119660 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: project_id.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.120619 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.120939 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: project-id
Jun 02 16:31:44.121253 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: providernet.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.122177 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.122691 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: provider
Jun 02 16:31:44.123007 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.126689 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.127223 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos not supported by any of loaded plugins
Jun 02 16:31:44.127618 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.128851 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.129358 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 02 16:31:44.129702 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.130595 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.131104 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 02 16:31:44.131422 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_default.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.132344 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.132854 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-default not supported by any of loaded plugins
Jun 02 16:31:44.133167 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_fip.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.133849 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.134343 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-fip not supported by any of loaded plugins
Jun 02 16:31:44.134654 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_gateway_ip.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.135556 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.136063 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 02 16:31:44.136376 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_port_network_policy.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.137252 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.137787 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 02 16:31:44.138097 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_rule_type_details.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.138966 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.139464 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 02 16:31:44.139775 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: qos_rules_alias.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.140809 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.141313 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 02 16:31:44.141641 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: quotasv2.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.142773 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.143145 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: quotas
Jun 02 16:31:44.143462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: quotasv2_detail.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.145097 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.145423 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: quota_details
Jun 02 16:31:44.145777 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: rbac.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.146839 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.147370 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: rbac-policies
Jun 02 16:31:44.147687 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: rbac_address_group.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.148591 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.149095 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: rbac-address-group
Jun 02 16:31:44.149406 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: rbac_address_scope.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.150322 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.150826 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: rbac-address-scope
Jun 02 16:31:44.151138 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: rbac_security_groups.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.152017 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.152523 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: rbac-security-groups
Jun 02 16:31:44.152836 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: rbac_subnetpool.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.153789 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.154292 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: rbac-subnetpool
Jun 02 16:31:44.154609 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: revisionifmatch.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.155501 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.156013 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: revision-if-match
Jun 02 16:31:44.156327 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: revisions.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.157426 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.157971 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: standard-attr-revisions
Jun 02 16:31:44.158287 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: router_availability_zone.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.159016 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.159523 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: router_availability_zone
Jun 02 16:31:44.159836 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: routerservicetype.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.160731 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.161246 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension router-service-type not supported by any of loaded plugins
Jun 02 16:31:44.161559 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.162460 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.162979 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: security-groups-normalized-cidr
Jun 02 16:31:44.163288 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: security_groups_port_filtering.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.164190 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.164684 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: port-security-groups-filtering
Jun 02 16:31:44.164994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.165910 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.166412 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: security-groups-remote-address-group
Jun 02 16:31:44.166721 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: securitygroup.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.178205 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.178763 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: security-group
Jun 02 16:31:44.179087 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: segment.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.179938 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.180448 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension segment not supported by any of loaded plugins
Jun 02 16:31:44.180765 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.181822 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.182333 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 02 16:31:44.182687 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: servicetype.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.183889 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.184411 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: service-type
Jun 02 16:31:44.184757 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: sorting.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.185797 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.186121 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: sorting
Jun 02 16:31:44.186419 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: standard_attr_segment.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.187365 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.187864 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 02 16:31:44.188179 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: standardattrdescription.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.188827 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.189329 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: standard-attr-description
Jun 02 16:31:44.189710 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: stateful_security_group.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.190730 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.191313 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: stateful-security-group
Jun 02 16:31:44.191548 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: stdattrs_common.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.192125 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 02 16:31:44.192410 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.193408 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.193941 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 02 16:31:44.194246 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnet_onboard.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.195346 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.195861 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: subnet_onboard
Jun 02 16:31:44.196194 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.197085 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.197585 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 02 16:31:44.197919 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnet_service_types.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.198815 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.199323 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: subnet-service-types
Jun 02 16:31:44.199632 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnetallocation.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.200704 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.201221 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: subnet_allocation
Jun 02 16:31:44.201532 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.202218 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.202718 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: subnetpool-prefix-ops
Jun 02 16:31:44.203028 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.203933 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.204433 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 02 16:31:44.204743 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: tagging.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.205913 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.206427 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: standard-attr-tag
Jun 02 16:31:44.206741 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: timestamp.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.207938 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.208449 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loaded extension: standard-attr-timestamp
Jun 02 16:31:44.208766 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: trunk.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.209810 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.210321 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension trunk not supported by any of loaded plugins
Jun 02 16:31:44.210640 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: trunk_details.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.211528 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.212030 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension trunk-details not supported by any of loaded plugins
Jun 02 16:31:44.212345 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: uplink_status_propagation.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.213243 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.213779 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 02 16:31:44.214092 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Loading extension file: vlantransparent.py {{(pid=98172) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 02 16:31:44.214757 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98172) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 02 16:31:44.215262 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 02 16:31:44.217840 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:network
Jun 02 16:31:44.218589 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnet
Jun 02 16:31:44.219384 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 02 16:31:44.219969 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:port
Jun 02 16:31:44.221360 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.222259 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service FLAVORS assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.222425 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.222880 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.223202 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:router
Jun 02 16:31:44.223934 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:floatingip
Jun 02 16:31:44.224589 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service METERING assigned prefix: /metering {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.226118 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d0ac5b0>> rbac-policy before_create 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.226423 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d0ac5b0>> rbac-policy before_update 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.226759 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f9b7d0ac5b0>> rbac-policy before_delete 55550000 {{(pid=98172) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:31:44.227964 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 02 16:31:44.228445 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:security_group
Jun 02 16:31:44.229152 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 02 16:31:44.230338 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service CORE assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.230692 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 02 16:31:44.231053 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] subnetpool is already registered
Jun 02 16:31:44.231764 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service CORE assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.232114 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 02 16:31:44.232460 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] subnetpool is already registered
Jun 02 16:31:44.235292 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.235764 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service FLAVORS assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.236394 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.236935 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.237266 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:router
Jun 02 16:31:44.237675 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] router is already registered
Jun 02 16:31:44.238336 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:floatingip
Jun 02 16:31:44.238686 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] floatingip is already registered
Jun 02 16:31:44.239363 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service METERING assigned prefix: /metering {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.240140 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 02 16:31:44.240491 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] rbac_policy is already registered
Jun 02 16:31:44.241059 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:security_group
Jun 02 16:31:44.241421 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] security_group is already registered
Jun 02 16:31:44.242088 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 02 16:31:44.242535 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] security_group_rule is already registered
Jun 02 16:31:44.243443 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service CORE assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.243879 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 02 16:31:44.244359 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] subnetpool is already registered
Jun 02 16:31:44.245056 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.v2.resource_helper [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Service CORE assigned prefix:  {{(pid=98172) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 02 16:31:44.245460 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 02 16:31:44.245837 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING neutron.quota.resource_registry [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] subnetpool is already registered
Jun 02 16:31:44.246606 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: extensions {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.248644 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: address-groups {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.250413 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: address-scopes {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.251869 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: agents {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.253312 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: auto-allocated-topology {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.254581 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: availability_zones {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.256021 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: dhcp-networks {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.257769 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: dhcp-agents {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.259191 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: routers {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.261039 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: flavors {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.262208 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: service_profiles {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.263419 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: next_providers {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.264926 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: service_profiles {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.266410 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: floatingip-pools {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.267602 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: routers {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.269492 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: floatingips {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.270691 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: l3-routers {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.272045 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: l3-agents {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.273439 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: metering-labels {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.274810 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: metering-label-rules {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.276091 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: network-ip-availabilities {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.277352 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: bindings {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.279017 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: quotas {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.280455 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: quotas {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.281875 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: rbac-policies {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.284436 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: security-groups {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.285691 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: security-group-rules {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.286927 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: service-providers {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.288148 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: subnetpools {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.408408 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: subnetpools {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.409960 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.411669 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.413507 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.415324 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.417118 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.418979 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.420687 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.422592 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.424420 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.426302 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron.api.extensions [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Extended resource: tags {{(pid=98172) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 02 16:31:44.432369 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING keystonemiddleware.auth_token [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 02 16:31:44.437168 dv-cinder-794021-2-iscsi neutron-server[98172]: WARNING keystonemiddleware.auth_token [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 02 16:31:44.445529 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Acquired lock "singleton_lock" {{(pid=98172) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 02 16:31:44.446027 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_concurrency.lockutils [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Releasing lock "singleton_lock" {{(pid=98172) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 02 16:31:44.446670 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Starting 2 workers
Jun 02 16:31:44.451331 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Started child 98277 {{(pid=98172) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 02 16:31:44.455960 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Started child 98278 {{(pid=98172) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 02 16:31:44.456574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.457536 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO neutron.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Neutron service started, listening on 0.0.0.0:9696
Jun 02 16:31:44.458127 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [-] (98277) wsgi starting up on http://0.0.0.0:9696
Jun 02 16:31:44.458283 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Notify callbacks [] for process, before_spawn {{(pid=98172) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.460761 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Starting 1 workers
Jun 02 16:31:44.463580 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.465815 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [-] (98278) wsgi starting up on http://0.0.0.0:9696
Jun 02 16:31:44.465953 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Started child 98279 {{(pid=98172) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 02 16:31:44.466419 dv-cinder-794021-2-iscsi neutron-server[98172]: INFO oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Starting 1 workers
Jun 02 16:31:44.469636 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] calling RpcWorker wait() {{(pid=98279) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 02 16:31:44.470232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] returning from RpcWorker wait() {{(pid=98279) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 02 16:31:44.470926 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Started child 98280 {{(pid=98172) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 02 16:31:44.471413 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.471734 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG neutron_lib.callbacks.manager [None req-5a8e8ab6-1c7c-469f-8601-ae37ee201358 None None] Notify callbacks [] for process, after_spawn {{(pid=98172) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.471999 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:31:44.473667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98172) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 02 16:31:44.473900 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 02 16:31:44.474054 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 02 16:31:44.474266 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 02 16:31:44.474628 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 02 16:31:44.474768 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 02 16:31:44.475285 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.475537 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.475800 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.476065 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.476431 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.476908 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.477168 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.477266 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:44.477799 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.477799 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.477927 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.478149 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.478241 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.478465 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.478639 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:31:44.478714 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.479068 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.479339 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.479957 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.480224 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.480361 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.480632 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.480881 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.481123 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.481383 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.481632 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.482221 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.482642 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.482642 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.482996 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.482996 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.483303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.483503 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.483745 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.483986 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.484199 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.484736 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.484736 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.484989 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.485111 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.485340 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.485472 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.485984 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] host                           = dv-cinder-794021-2-iscsi {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.486200 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.486457 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.486705 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.487002 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.487233 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.487441 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.487671 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.487920 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.488140 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.488374 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.488602 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.488840 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.489077 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.489328 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.489456 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.489715 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.489992 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.490239 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.490424 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.490562 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.490735 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.490979 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.491172 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.491367 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.491608 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.491908 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.492054 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.492247 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.492453 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.492679 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.492912 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.493116 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.493326 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.493575 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.493846 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.494054 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.494284 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.494495 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.494687 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.494909 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.495130 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.495347 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.495595 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.495731 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.495965 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.496187 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.496441 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.496694 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.496887 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.497106 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.497322 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.497526 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.497836 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.498012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.498363 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.498734 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.499382 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.499382 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.499730 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.499878 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.500083 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.500297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.500552 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.500758 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.501093 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.501228 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.501347 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.501627 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.501830 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.502279 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.502548 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.502875 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.503104 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.503359 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.503610 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.504304 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.504304 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.504620 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.504766 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.506399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.506399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.506399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.506399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.506399 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.509708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.25/identity {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.510667 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.511573 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512271 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512271 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512271 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512588 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512690 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.512913 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.513472 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.513472 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.513723 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.513828 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.513964 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.514210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.514409 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.514733 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.515071 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.515311 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.515463 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.515691 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.515883 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.516108 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.516356 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.516533 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.516768 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.517402 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.517402 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.517729 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.517729 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.518050 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.518275 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.518501 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.518695 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.518919 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.519130 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.519347 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.519572 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.519821 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.520309 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.520408 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.520963 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.521876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.521876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.521876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.521876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525449 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.525949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.526417 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.526417 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.526417 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.526584 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.526711 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.527094 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.527538 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.527834 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.528066 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.528488 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.528928 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.529384 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.529718 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.529909 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.530145 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.530429 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.530898 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.531152 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.532062 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.532446 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.532685 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.532984 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.533256 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.533594 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.533817 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.534105 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.534349 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.534620 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.534867 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.535124 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.535384 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.535682 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.535920 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.536176 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.536420 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.536796 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.537004 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.537256 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.537491 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.537753 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.537996 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.538271 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.538537 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.538816 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.539060 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.539295 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.539534 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.539815 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.25/identity {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.539998 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.540225 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.540457 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.540683 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.540906 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.541119 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.541335 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.541567 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.542641 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.542914 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.543141 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.543374 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.543616 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.543841 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.544061 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.544313 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.545499 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.545499 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.545697 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.545925 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.546131 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.546374 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.546595 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.546854 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.547094 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.547367 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.547629 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.547860 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.548106 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.548372 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.548871 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.548871 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.549070 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.549335 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.549647 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.550020 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.550246 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.550460 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.550690 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.550952 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.551161 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.551591 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.551829 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.552159 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.552414 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.552636 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.552895 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.553113 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.553345 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.553806 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.554200 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.554617 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.554868 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.555089 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.555367 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.555629 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.555866 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.556097 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.556303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.556508 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.556887 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.557256 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.557727 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.558123 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.558493 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.558866 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.559243 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.559507 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.559723 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.559939 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.560163 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.560375 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.560600 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.560833 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.561050 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.561288 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.561498 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.561747 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.561980 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.562209 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.562429 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.562641 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.562864 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.563073 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.563284 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.563501 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.563708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.564049 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.564312 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.564553 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.564892 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.565143 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.565370 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.565654 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.565970 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.566197 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.566453 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.566707 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.566914 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.567131 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.567575 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.567970 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.568261 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.568512 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.568763 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.569024 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.569302 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.569541 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.569787 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.570082 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.570411 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.570694 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.570959 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.571202 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.571479 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.571732 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.571949 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.572186 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.572429 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.572646 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.572883 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.573127 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.573347 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.573580 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.573837 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.574142 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.574281 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.574529 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.574711 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.575083 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.575247 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 02 16:31:44.575813 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98172) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 02 16:31:44.575976 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 02 16:31:44.576128 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 02 16:31:44.576296 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 02 16:31:44.576462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 02 16:31:44.576612 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 02 16:31:44.576817 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.576976 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577134 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577290 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577447 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577650 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577818 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.577975 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578129 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578283 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578438 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578597 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578751 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.578907 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579065 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579220 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579375 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579531 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579693 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.579854 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580008 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580163 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580317 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580537 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580741 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.580902 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581057 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581221 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581377 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581532 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581717 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.581874 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582030 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582186 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582341 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582497 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582807 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.582963 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583122 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583272 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] host                           = dv-cinder-794021-2-iscsi {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583427 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583582 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583736 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.583889 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584051 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584204 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584346 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584647 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584795 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.584952 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585432 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585432 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585432 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585792 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585792 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.585994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586216 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586327 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586466 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586635 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586759 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.586918 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587073 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587229 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587384 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587542 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587695 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.587874 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588009 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588164 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588320 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588476 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588632 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588787 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.588961 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589085 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589243 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589404 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589538 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589733 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.589894 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.590050 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.590211 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.590369 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.590511 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.590863 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591024 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591173 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591328 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591485 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591786 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.591955 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.592110 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.592268 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.592430 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.592586 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.592890 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593052 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593215 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593422 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593549 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593707 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.593871 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594250 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594250 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594637 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594637 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594637 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 02 16:31:44.594986 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.594986 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595151 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595233 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595356 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595515 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595675 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.595834 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596016 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596328 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596504 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596666 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596834 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.596993 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597152 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597314 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597502 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597714 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597854 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.597980 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598118 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598234 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598406 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598564 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598724 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.25/identity {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.598903 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599062 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599230 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599390 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599558 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599718 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.599881 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600047 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600204 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600520 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600680 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.600844 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601040 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601178 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601319 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601486 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601669 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.601810 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.602127 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46182) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:31:44.602312 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.602486 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.602646 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.602810 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.602975 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.603129 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.603297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.603585 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.603898 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.604032 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.604196 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.604353 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.604961 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605087 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605193 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605417 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605548 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605788 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.605988 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606108 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606316 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606406 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606560 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606723 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.606883 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607075 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607234 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607373 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607559 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607662 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607857 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.607982 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.608121 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.608253 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.608544 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.608845 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.608996 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.609150 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.609489 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.609922 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.609922 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.610127 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.610234 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.610336 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.610456 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.610745 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611065 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611285 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611416 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611533 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611881 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.611975 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612112 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612291 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612404 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612564 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612720 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612830 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.612994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.613191 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.613315 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.613509 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.613678 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.613787 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [-] 10.222.0.25 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0083492
Jun 02 16:31:44.613916 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614026 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614128 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614379 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614501 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614605 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614707 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.614940 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615063 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615179 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615390 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615515 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615618 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615820 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.615939 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616080 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616244 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616388 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616544 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616703 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.616876 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617033 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617187 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617344 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617506 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617708 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.617868 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618025 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618188 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618343 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618459 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:31:44.618599 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.618994 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619297 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619522 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.25/identity {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619522 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619709 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.619810 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620060 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620227 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620393 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620393 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620717 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.620717 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621051 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621051 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621358 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621358 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621724 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.621724 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622055 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622055 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622355 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622355 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622610 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622610 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622801 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.622902 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623159 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623265 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623424 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623583 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623740 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.623894 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624046 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624195 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624342 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624528 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624694 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.624855 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.625052 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.625240 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.625240 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.625630 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.625630 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626012 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626556 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626556 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.626556 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627138 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627138 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627138 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627138 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.627997 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.629303 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.630458 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.631462 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632114 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632114 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632114 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632114 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632114 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632739 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632739 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632739 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.632739 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633255 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633255 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633255 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.633652 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.635086 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.636364 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.637778 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.639451 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.640210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.640210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.640210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.640210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 02 16:31:44.640210 dv-cinder-794021-2-iscsi neutron-server[98172]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 02 16:31:56.008531 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4b11453-4cdb-4a40-9f43-2dd7f61f615b None None] get_active_networks_info from dv-cinder-794021-2-iscsi {{(pid=98279) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 02 16:31:56.120893 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b11453-4cdb-4a40-9f43-2dd7f61f615b None None] No non-hosted networks {{(pid=98279) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 02 16:31:56.148260 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.agentschedulers_db [None req-f4b11453-4cdb-4a40-9f43-2dd7f61f615b None None] DHCP Agent not found on host dv-cinder-794021-2-iscsi {{(pid=98279) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
Jun 02 16:31:56.307518 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e7a57f04-ce18-4227-b71e-d8938fac7346 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:58.446902 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a9d4afbe-33f7-471a-9071-2e0d48eac7ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:58.521295 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cd17258c-6302-40d3-abc6-81fd30e97744 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:58.771295 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:31:58.772120 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.772678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.775775 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.776192 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.778024 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.779916 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.781552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.782182 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.783321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.786126 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.788512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.792950 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:31:58.798761 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f9b7c4bbd60>, 'Open vSwitch agent', 'dv-cinder-794021-2-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:31:58.813052 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f9b7cdadc40>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-794021-2-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:00.200848 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:00.998903 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.db.l3_hamode_db [None req-341ddf42-b8ca-4656-9300-099f649f0fd7 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 02 16:32:01.110255 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341ddf42-b8ca-4656-9300-099f649f0fd7 None None] Routers set() bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:32:01.110824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341ddf42-b8ca-4656-9300-099f649f0fd7 None None] Router IDs set() for agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 02 16:32:01.826195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:03.211823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46276) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:03.856298 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING oslo_policy.policy [None req-72c1d770-5b26-41e1-8f5e-d094cd2765a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:03.856887 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING oslo_policy.policy [None req-72c1d770-5b26-41e1-8f5e-d094cd2765a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:04.068865 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [None req-72c1d770-5b26-41e1-8f5e-d094cd2765a0 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98278) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:32:04.069945 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-72c1d770-5b26-41e1-8f5e-d094cd2765a0 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8571599
Jun 02 16:32:06.480099 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46290) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:06.863342 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'shared': True, 'is_default': True, 'default_prefixlen': 26}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:06.962051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.policy [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98278) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 02 16:32:07.009005 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING oslo_policy.policy [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:07.009386 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING oslo_policy.policy [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:07.018406 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.quota [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f9b7cacacd0>.
Jun 02 16:32:07.034376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:07.100041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113470516', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113470041', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113457471', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113487299', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113480524', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769113635498', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3577495', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3762565', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-615420', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-541526'] for rbac-policy, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:07.172665 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:07.174220 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-97b42899-7d7b-4cfe-9941-efbc9cc30d68 admin admin] 10.222.0.25 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6928990
Jun 02 16:32:09.990496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46302) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:10.684520 dv-cinder-794021-2-iscsi neutron-server[98277]: WARNING oslo_policy.policy [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:10.685072 dv-cinder-794021-2-iscsi neutron-server[98277]: WARNING oslo_policy.policy [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:10.903548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Request body: {'network': {'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'name': 'private'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:10.905258 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.quota [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f9b7cdf15b0>.
Jun 02 16:32:10.922517 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:10.930403 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Usage tracker for resource:network and tenant:868ce75f161644e0a73a3c1a3ae2756f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:10.936764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:10.945758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:10.964891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Made reservation on behalf of 868ce75f161644e0a73a3c1a3ae2756f for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:32:11.039485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.policy [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98277) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 02 16:32:11.086930 dv-cinder-794021-2-iscsi neutron-server[98277]: WARNING oslo_policy.policy [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:11.087316 dv-cinder-794021-2-iscsi neutron-server[98277]: WARNING oslo_policy.policy [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 02 16:32:11.097884 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.120137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.136630 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:11.141234 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Usage tracker for resource:security_group_rule and tenant:868ce75f161644e0a73a3c1a3ae2756f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:11.147592 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:11.158382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:11.281768 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.287003 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.293293 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:11.312448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] vlan segment allocate from pool success with {'vlan_id': 659, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:32:11.341144 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8769112582732', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.341791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f9b7d72a4c0> segment precommit_create {{(pid=98277) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 02 16:32:11.342249 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Added segment 7059ede0-e960-4d88-b033-9327f2a3c041 of type vlan for network 8dd70fab-286c-4cd6-abfc-3ae272d12e00
Jun 02 16:32:11.400175 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deb34b83-c804-4844-a123-bf8733afe014,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:11.422739 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.423004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.423266 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.423576 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.423962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.424281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.424590 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.424896 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.425206 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.425503 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.425827 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.426120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Tracked resource versions report:
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]: pushed versions:
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]: {   'AddressGroup': {'1.2'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'ConntrackHelper': {'1.0'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Log': {'1.0'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Network': {'1.1'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Port': {'1.7'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'PortForwarding': {'1.2'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'QosPolicy': {'1.8'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SecurityGroup': {'1.4'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SubPort': {'1.0'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Subnet': {'1.1'},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Trunk': {'1.1'}}
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]: consumer versions:
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Log': '1.0',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Network': '1.1',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Port': '1.7',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'PortForwarding': '1.2',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'QosPolicy': '1.8',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SecurityGroup': '1.4',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SubPort': '1.0',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Subnet': '1.1',
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Trunk': '1.1'}}
Jun 02 16:32:11.427248 dv-cinder-794021-2-iscsi neutron-server[98277]:  {{(pid=98277) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:32:11.485047 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.498323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:11.537579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.539308 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:11.540000 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:11.543744 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:11.653788 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.6610627
Jun 02 16:32:11.660131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Pushing event updated for resources: {'Network': ['ID=8dd70fab-286c-4cd6-abfc-3ae272d12e00,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:11.666254 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:11.676163 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:32:14.461561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46324) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:14.962527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4415fa00-a360-45ca-b3bf-2831afda74d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:14.963807 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-4415fa00-a360-45ca-b3bf-2831afda74d1 admin admin] 10.222.0.25 "GET /v2.0/networks/8dd70fab-286c-4cd6-abfc-3ae272d12e00 HTTP/1.1" status: 200  len: 825 time: 0.5011985
Jun 02 16:32:14.996755 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bb5cac78-1f10-4082-b25e-894e5e6fdedf admin admin] 10.222.0.25 "GET /v2.0/subnetpools/ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd HTTP/1.1" status: 200  len: 734 time: 0.0273311
Jun 02 16:32:15.005911 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Request body: {'subnet': {'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'gateway_ip': '172.20.0.1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd', 'name': 'private-subnet', 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:15.011103 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:15.015421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Usage tracker for resource:subnet and tenant:868ce75f161644e0a73a3c1a3ae2756f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:15.018851 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:15.025152 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:15.038210 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Made reservation on behalf of 868ce75f161644e0a73a3c1a3ae2756f for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:32:15.040730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:15.524239 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:15.528319 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:15.608629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6fb54b9e-12cf-4b58-805e-29e94cef493e,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:15.612912 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Checking segment: {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:32:15.613290 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Network hostable DHCP agents. Network: 8dd70fab-286c-4cd6-abfc-3ae272d12e00, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:32:15.616303 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:15.634299 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:32:15.644915 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 8dd70fab-286c-4cd6-abfc-3ae272d12e00) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:15.649785 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:15.650385 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:15.656731 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-073ce46c-161d-4802-9713-4915fd265fd6 None None] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:32:15.674058 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-827b15ae-6263-494f-bb57-8107b7a84fd9 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6716683
Jun 02 16:32:16.050516 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:32:16.052437 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.259435 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Allocated IP 172.20.0.2 (8dd70fab-286c-4cd6-abfc-3ae272d12e00/6fb54b9e-12cf-4b58-805e-29e94cef493e/192489a8-31c2-4cb5-a016-86a46c47c257) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:32:16.535238 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.550898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Transition to ACTIVE for port object 192489a8-31c2-4cb5-a016-86a46c47c257 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:32:16.578340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Transition to ACTIVE for port object 192489a8-31c2-4cb5-a016-86a46c47c257 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:32:16.587927 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.597477 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:16.676643 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:32:16.680154 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:16.688917 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:32:16.695672 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Pushing event updated for resources: {'Port': ['ID=192489a8-31c2-4cb5-a016-86a46c47c257,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:16.741645 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.741935 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.742256 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.742601 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.742913 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.743319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.743636 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.743944 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.744243 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.744554 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.744858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.745163 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Tracked resource versions report:
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]: pushed versions:
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]: {   'AddressGroup': {'1.2'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'ConntrackHelper': {'1.0'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Log': {'1.0'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Network': {'1.1'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Port': {'1.7'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'PortForwarding': {'1.2'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'QosPolicy': {'1.8'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SecurityGroup': {'1.4'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SubPort': {'1.0'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Subnet': {'1.1'},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Trunk': {'1.1'}}
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]: consumer versions:
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Log': '1.0',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Network': '1.1',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Port': '1.7',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'PortForwarding': '1.2',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'QosPolicy': '1.8',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SecurityGroup': '1.4',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SubPort': '1.0',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Subnet': '1.1',
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Trunk': '1.1'}}
Jun 02 16:32:16.746344 dv-cinder-794021-2-iscsi neutron-server[98279]:  {{(pid=98279) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:32:16.778307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:16.801473 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Attempting to bind port 192489a8-31c2-4cb5-a016-86a46c47c257 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:32:16.801905 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Attempting to bind port 192489a8-31c2-4cb5-a016-86a46c47c257 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:32:16.802318 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Attempting to bind port 192489a8-31c2-4cb5-a016-86a46c47c257 on network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:32:16.808721 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 31, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:32:16.809123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Checking segment: {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:32:16.809579 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.809995 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Bound using segment: {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:32:16.810506 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Bound port: 192489a8-31c2-4cb5-a016-86a46c47c257, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:32:16.810877 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.910573 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] For port 192489a8-31c2-4cb5-a016-86a46c47c257, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:32:16.915517 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] For port 192489a8-31c2-4cb5-a016-86a46c47c257, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=192489a8-31c2-4cb5-a016-86a46c47c257,segment=NetworkSegment(7059ede0-e960-4d88-b033-9327f2a3c041),segment_id=7059ede0-e960-4d88-b033-9327f2a3c041)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:32:16.922642 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:16.929680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:17.022858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Pushing event updated for resources: {'Port': ['ID=192489a8-31c2-4cb5-a016-86a46c47c257,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:17.026152 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:18.201267 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46332) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:18.702523 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [None req-b8846087-7d3d-4d40-93ad-a9848a424e5c admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:32:18.703887 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b8846087-7d3d-4d40-93ad-a9848a424e5c admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.5014696
Jun 02 16:32:21.282794 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46340) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:21.714882 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [None req-1d67ad53-86ad-4af5-83ef-ef4b24fa36ba admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:32:21.716091 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1d67ad53-86ad-4af5-83ef-ef4b24fa36ba admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4323008
Jun 02 16:32:22.732862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e58c148-f141-4d5c-a0cc-c534c36234be None None] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:32:22.865554 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e6cfac1c-83c3-41d0-b321-5a7268d693fd None None] Provisioning for port 192489a8-31c2-4cb5-a016-86a46c47c257 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:32:23.211392 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 192489a8-31c2-4cb5-a016-86a46c47c257 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:23.301946 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 192489a8-31c2-4cb5-a016-86a46c47c257 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:32:23.306699 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-cb50405c-c30b-4044-9d05-a178bead4634 None None] Provisioning complete for port 192489a8-31c2-4cb5-a016-86a46c47c257 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:23.307095 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cb50405c-c30b-4044-9d05-a178bead4634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:23.333667 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 192489a8-31c2-4cb5-a016-86a46c47c257 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:23.334040 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:23.528227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:23.537398 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cb50405c-c30b-4044-9d05-a178bead4634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:23.583525 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 192489a8-31c2-4cb5-a016-86a46c47c257, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=192489a8-31c2-4cb5-a016-86a46c47c257,segment=NetworkSegment(7059ede0-e960-4d88-b033-9327f2a3c041),segment_id=7059ede0-e960-4d88-b033-9327f2a3c041)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:32:23.589262 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:23.616834 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:23.699945 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.db.api [None req-cb50405c-c30b-4044-9d05-a178bead4634 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=98279) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 02 16:32:23.699945 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_db.api [None req-cb50405c-c30b-4044-9d05-a178bead4634 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 02 16:32:23.705011 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=192489a8-31c2-4cb5-a016-86a46c47c257,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:23.708904 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:24.491141 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46354) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:24.858805 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Request body: {'router': {'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'name': 'router1'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:24.864160 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:24.868137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Usage tracker for resource:router and tenant:868ce75f161644e0a73a3c1a3ae2756f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:24.871617 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:24.877635 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:24.890378 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:24.892058 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:24.915867 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:25.032388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:25.052843 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:25.054070 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-4ae5b198-7d14-4346-80d7-36cf8923907b admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5618515
Jun 02 16:32:25.159138 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 192489a8-31c2-4cb5-a016-86a46c47c257 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:25.229249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 192489a8-31c2-4cb5-a016-86a46c47c257 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:25.229976 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:25.784457 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-768d7c5a-a081-47c3-82d1-e3903a3a8fed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:27.449353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46362) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:27.855678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [None req-5ab36f4c-524c-438b-a36e-150b0e7f2950 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:32:27.856759 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-5ab36f4c-524c-438b-a36e-150b0e7f2950 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4064045
Jun 02 16:32:28.447783 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-2cce1d7a-509a-4133-a73d-cf54e79aaf5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:28.749094 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.127782 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.577414 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46380) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:30.742814 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'router:external': True, 'is_default': True, 'provider:network_type': 'flat'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:30.748092 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:30.752249 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Usage tracker for resource:network and tenant:36db871ce425411caa9e6f27cd86ee15 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:30.755234 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:30.761373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:30.773301 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Made reservation on behalf of 36db871ce425411caa9e6f27cd86ee15 for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:32:30.775731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.788499 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.809356 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:30.815233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Usage tracker for resource:security_group_rule and tenant:36db871ce425411caa9e6f27cd86ee15 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:30.818415 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:30.825018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:30.936629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.941192 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.944784 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:30.960952 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Reserving flat network on physical network physnet1 {{(pid=98277) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 02 16:32:30.982639 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d2a991a-1ec4-4bf3-ab99-6111385bdea0,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:30.986981 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:30.987972 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:30.988311 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Added segment 234bfbc8-daac-48b7-b048-c18c5c7873a6 of type flat for network 111563ce-426b-47b0-ac88-407bffa30df5
Jun 02 16:32:31.021858 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:31.060316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:31.061716 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:31.062362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:31.065984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:31.165578 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.5869932
Jun 02 16:32:31.171117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Pushing event updated for resources: {'Network': ['ID=111563ce-426b-47b0-ac88-407bffa30df5,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:31.179697 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:31.192930 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 111563ce-426b-47b0-ac88-407bffa30df5 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:32:31.775253 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:33.378685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46398) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:33.519861 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8916db0f-9dd0-4cfe-8b5b-027160aa2fa7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:33.521353 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8916db0f-9dd0-4cfe-8b5b-027160aa2fa7 admin admin] 10.222.0.25 "GET /v2.0/subnets/6fb54b9e-12cf-4b58-805e-29e94cef493e HTTP/1.1" status: 200  len: 849 time: 0.1416967
Jun 02 16:32:33.703589 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1e074c4e-5992-4d36-a09a-d9a2e219a790 admin admin] 10.222.0.25 "GET /v2.0/routers/89fcbf2a-4293-4240-8162-a45dd7792fef HTTP/1.1" status: 200  len: 704 time: 0.1763496
Jun 02 16:32:34.198510 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:34.445328 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Allocated IP 172.20.0.1 (8dd70fab-286c-4cd6-abfc-3ae272d12e00/6fb54b9e-12cf-4b58-805e-29e94cef493e/3f3c19c1-6d38-44a2-b46c-cf4e364c1083) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:32:34.617196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:34.637347 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Transition to ACTIVE for port object 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:32:34.699992 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:34.705098 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:34.765056 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:32:34.766241 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:34.802970 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Pushing event updated for resources: {'Port': ['ID=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:34.811128 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:32:34.811679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:34.932314 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.932625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.932987 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.933308 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.933641 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.933993 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.934287 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.934598 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.934964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.935279 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.935670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.935883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Tracked resource versions report:
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]: pushed versions:
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]: {   'AddressGroup': {'1.2'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'ConntrackHelper': {'1.0'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Log': {'1.0'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Network': {'1.1'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Port': {'1.7'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'PortForwarding': {'1.2'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'QosPolicy': {'1.8'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SecurityGroup': {'1.4'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SubPort': {'1.0'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Subnet': {'1.1'},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Trunk': {'1.1'}}
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]: consumer versions:
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Log': '1.0',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Network': '1.1',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Port': '1.7',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'PortForwarding': '1.2',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'QosPolicy': '1.8',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SecurityGroup': '1.4',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SubPort': '1.0',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Subnet': '1.1',
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Trunk': '1.1'}}
Jun 02 16:32:34.937032 dv-cinder-794021-2-iscsi neutron-server[98278]:  {{(pid=98278) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:32:34.949515 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:35.039756 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ea92b9a7-7307-4981-a2a1-61121123c9fc None None] Provisioning for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:32:35.045037 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ea92b9a7-7307-4981-a2a1-61121123c9fc None None] Provisioning complete for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:35.045379 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ea92b9a7-7307-4981-a2a1-61121123c9fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.093867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.104450 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ea92b9a7-7307-4981-a2a1-61121123c9fc None None] Port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:32:35.331906 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.340718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.341863 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.345555 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:35.475678 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Pushing event updated for resources: {'Port': ['ID=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:35.480393 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:35.582396 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:32:35.583611 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:35.801030 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Router 89fcbf2a-4293-4240-8162-a45dd7792fef is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98278) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:32:35.837321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-398b6244-3d59-4171-956e-d413c618aac6 None None] Provisioning complete for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:35.837708 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-398b6244-3d59-4171-956e-d413c618aac6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:35.924107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-398b6244-3d59-4171-956e-d413c618aac6 None None] Port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:32:35.967303 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:32:35.978191 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Sync routers for ids ['89fcbf2a-4293-4240-8162-a45dd7792fef'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:32:35.983614 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] 10.222.0.25 "PUT /v2.0/routers/89fcbf2a-4293-4240-8162-a45dd7792fef/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.2731605
Jun 02 16:32:35.989921 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Routers {'89fcbf2a-4293-4240-8162-a45dd7792fef'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:32:35.990856 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cd9b310>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:32:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['89fcbf2a-4293-4240-8162-a45dd7792fef'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:36.248880 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Set router 89fcbf2a-4293-4240-8162-a45dd7792fef gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:32:36.698234 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cd9b310>, [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:35Z', 'revision_number': 2, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port_host': None, '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:35Z', 'revision_number': 2, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:36.703901 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Checking router: 89fcbf2a-4293-4240-8162-a45dd7792fef for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:32:36.704255 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Updating router 89fcbf2a-4293-4240-8162-a45dd7792fef port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:32:36.761473 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.215342 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.234966 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Transition to ACTIVE for port object 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:32:37.243331 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.249236 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:37.460257 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Pushing event updated for resources: {'Port': ['ID=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:37.483406 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.483767 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.484061 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.484385 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.484710 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.485022 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.485334 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.485711 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.486154 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.486466 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.486774 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.487081 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Tracked resource versions report:
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]: pushed versions:
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]: {   'AddressGroup': {'1.2'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'ConntrackHelper': {'1.0'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Log': {'1.0'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Network': {'1.1'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Port': {'1.7'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'PortForwarding': {'1.2'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'QosPolicy': {'1.8'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SecurityGroup': {'1.4'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SubPort': {'1.0'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Subnet': {'1.1'},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Trunk': {'1.1'}}
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]: consumer versions:
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Log': '1.0',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Network': '1.1',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Port': '1.7',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'PortForwarding': '1.2',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'QosPolicy': '1.8',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SecurityGroup': '1.4',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SubPort': '1.0',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Subnet': '1.1',
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Trunk': '1.1'}}
Jun 02 16:32:37.488226 dv-cinder-794021-2-iscsi neutron-server[98280]:  {{(pid=98280) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:32:37.492481 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Attempting to bind port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:32:37.492877 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Attempting to bind port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:32:37.493298 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Attempting to bind port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 on network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:32:37.498011 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:37.501036 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 32, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:32:37.501263 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Checking segment: {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:32:37.501792 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.502178 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Bound using segment: {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:32:37.502696 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Bound port: 3f3c19c1-6d38-44a2-b46c-cf4e364c1083, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7059ede0-e960-4d88-b033-9327f2a3c041', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:32:37.503075 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.613485 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] For port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:32:37.619340 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] For port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,segment=NetworkSegment(7059ede0-e960-4d88-b033-9327f2a3c041),segment_id=7059ede0-e960-4d88-b033-9327f2a3c041)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:32:37.627456 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:37.635671 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:37.785535 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Routers {'89fcbf2a-4293-4240-8162-a45dd7792fef'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:32:37.786367 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cd9b310>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:32:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['89fcbf2a-4293-4240-8162-a45dd7792fef'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:37.860252 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Pushing event updated for resources: {'Port': ['ID=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:37.863801 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:38.025206 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] Set router 89fcbf2a-4293-4240-8162-a45dd7792fef gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:32:38.183623 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46412) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:38.336009 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf89bd2d-f2e2-4228-833f-9456d86842b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:38.337388 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-cf89bd2d-f2e2-4228-833f-9456d86842b1 admin admin] 10.222.0.25 "GET /v2.0/networks/111563ce-426b-47b0-ac88-407bffa30df5 HTTP/1.1" status: 200  len: 842 time: 0.1528783
Jun 02 16:32:38.347716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Request body: {'subnet': {'enable_dhcp': False, 'ip_version': 4, 'gateway_ip': '172.27.0.1', 'name': 'public-subnet', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'cidr': '172.27.0.0/24'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:38.353799 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:32:38.358605 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Usage tracker for resource:subnet and tenant:36db871ce425411caa9e6f27cd86ee15 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:32:38.361955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:32:38.373307 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:32:38.390721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Made reservation on behalf of 36db871ce425411caa9e6f27cd86ee15 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:32:38.393655 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Notify callbacks [] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:38.555673 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cd9b310>, [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:35Z', 'revision_number': 2, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port_host': None, '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:37Z', 'revision_number': 4, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:38.561800 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f08eaa-df78-4789-89dc-56a5e3f51573 None None] The sync data for ids ['89fcbf2a-4293-4240-8162-a45dd7792fef'] in dv-cinder-794021-2-iscsi is: [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:35Z', 'revision_number': 2, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port_host': None, '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:37Z', 'revision_number': 4, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:32:38.967950 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.objects.ports [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=98278) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 02 16:32:38.968527 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:38.974801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:39.091712 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Pushing event updated for resources: {'Subnet': ['ID=7e7273ca-7a6e-4dbc-a88a-c692752bdd51,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:39.099971 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:39.110095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:32:39.110759 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Network hostable DHCP agents. Network: 111563ce-426b-47b0-ac88-407bffa30df5, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:32:39.140517 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:32:39.155231 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 111563ce-426b-47b0-ac88-407bffa30df5) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:39.160776 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:39.161778 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:39.166864 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feb42d06-bd26-40bf-815b-661a27e0bb61 None None] Network 111563ce-426b-47b0-ac88-407bffa30df5 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:32:39.209641 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.8532894
Jun 02 16:32:39.424314 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17c4e29b-62ca-4446-a70c-5cc78b3fd10d None None] Network 111563ce-426b-47b0-ac88-407bffa30df5 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:32:41.558338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 46424) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:41.769405 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-157205e3-4535-49fa-b143-96c6e0c83e17 admin admin] 10.222.0.25 "GET /v2.0/routers/89fcbf2a-4293-4240-8162-a45dd7792fef HTTP/1.1" status: 200  len: 710 time: 0.2095892
Jun 02 16:32:41.974791 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b37b466-6db0-4662-8d49-f98c963fd532 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:32:41.976226 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4b37b466-6db0-4662-8d49-f98c963fd532 admin admin] 10.222.0.25 "GET /v2.0/networks/111563ce-426b-47b0-ac88-407bffa30df5 HTTP/1.1" status: 200  len: 886 time: 0.2013335
Jun 02 16:32:41.988229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:32:42.453222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:42.822995 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:42.885099 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.029348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Allocated IP 172.27.0.68 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/16c75b0b-41a7-42d6-b407-1b467eca6d71) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:32:43.194271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.207729 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:43.239123 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.244030 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:43.293131 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:32:43.299004 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:43.299456 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.312886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:32:43.315194 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:32:43.317167 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Pushing event updated for resources: {'Port': ['ID=16c75b0b-41a7-42d6-b407-1b467eca6d71,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:43.328687 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:32:43.435587 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.479086 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,segment=NetworkSegment(7059ede0-e960-4d88-b033-9327f2a3c041),segment_id=7059ede0-e960-4d88-b033-9327f2a3c041)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:32:43.485385 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:43.488735 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:43.528704 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:43.561081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=3f3c19c1-6d38-44a2-b46c-cf4e364c1083,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:43.564775 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:43.883235 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:44.233749 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:44.237534 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-683661', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-683674', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-761382'] for router, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:44.449560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Router 89fcbf2a-4293-4240-8162-a45dd7792fef has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:32:44.530142 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:32:44.694305 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:32:44.707349 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Sync routers for ids ['89fcbf2a-4293-4240-8162-a45dd7792fef'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:32:44.708756 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Notify callbacks [] for router, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:44.710321 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] 10.222.0.25 "PUT /v2.0/routers/89fcbf2a-4293-4240-8162-a45dd7792fef HTTP/1.1" status: 200  len: 889 time: 2.7255614
Jun 02 16:32:44.724365 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Routers {'89fcbf2a-4293-4240-8162-a45dd7792fef'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:32:44.725502 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c08e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:32:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['89fcbf2a-4293-4240-8162-a45dd7792fef'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:45.010921 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Set router 89fcbf2a-4293-4240-8162-a45dd7792fef gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:32:45.217352 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:45.411301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:45.411668 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:45.608165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c08e0>, [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68'}], 'enable_snat': True}, 'gw_port_id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 4, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port': {'id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:f6:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:42Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 5, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:45.614759 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Checking router: 89fcbf2a-4293-4240-8162-a45dd7792fef for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:32:45.615123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Updating router 89fcbf2a-4293-4240-8162-a45dd7792fef port 16c75b0b-41a7-42d6-b407-1b467eca6d71 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:32:45.675688 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.067323 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.082817 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Transition to ACTIVE for port object 16c75b0b-41a7-42d6-b407-1b467eca6d71 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:32:46.092068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.097445 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:46.180181 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Attempting to bind port 16c75b0b-41a7-42d6-b407-1b467eca6d71 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:32:46.180545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Attempting to bind port 16c75b0b-41a7-42d6-b407-1b467eca6d71 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:32:46.180913 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Attempting to bind port 16c75b0b-41a7-42d6-b407-1b467eca6d71 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:32:46.183257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Pushing event updated for resources: {'Port': ['ID=16c75b0b-41a7-42d6-b407-1b467eca6d71,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:46.187184 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:46.190063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 32, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:32:46.190438 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:32:46.190843 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.191234 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:32:46.191715 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Bound port: 16c75b0b-41a7-42d6-b407-1b467eca6d71, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:32:46.192093 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.278080 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] For port 16c75b0b-41a7-42d6-b407-1b467eca6d71, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:32:46.282815 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] For port 16c75b0b-41a7-42d6-b407-1b467eca6d71, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=16c75b0b-41a7-42d6-b407-1b467eca6d71,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:32:46.288434 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:46.293151 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:46.376471 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Routers {'89fcbf2a-4293-4240-8162-a45dd7792fef'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:32:46.377107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c08e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:32:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['89fcbf2a-4293-4240-8162-a45dd7792fef'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:46.428902 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Pushing event updated for resources: {'Port': ['ID=16c75b0b-41a7-42d6-b407-1b467eca6d71,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:46.437540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:46.583387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] Set router 89fcbf2a-4293-4240-8162-a45dd7792fef gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:32:46.938038 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c08e0>, [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68'}], 'enable_snat': True}, 'gw_port_id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 4, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port': {'id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:f6:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:42Z', 'updated_at': '2021-06-02T16:32:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 5, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:32:46.943475 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7abf033-ade1-4a2e-ab29-4d05e70947aa None None] The sync data for ids ['89fcbf2a-4293-4240-8162-a45dd7792fef'] in dv-cinder-794021-2-iscsi is: [{'id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'name': 'router1', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68'}], 'enable_snat': True}, 'gw_port_id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:32:24Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 4, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'gw_port': {'id': '16c75b0b-41a7-42d6-b407-1b467eca6d71', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:f6:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:42Z', 'updated_at': '2021-06-02T16:32:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '3f3c19c1-6d38-44a2-b46c-cf4e364c1083', 'name': '', 'network_id': '8dd70fab-286c-4cd6-abfc-3ae272d12e00', 'tenant_id': '868ce75f161644e0a73a3c1a3ae2756f', 'mac_address': 'fa:16:3e:16:e2:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89fcbf2a-4293-4240-8162-a45dd7792fef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:32:34Z', 'updated_at': '2021-06-02T16:32:43Z', 'revision_number': 5, 'project_id': '868ce75f161644e0a73a3c1a3ae2756f', 'subnets': [{'id': '6fb54b9e-12cf-4b58-805e-29e94cef493e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ec461ba5-dd8f-4c1d-b2e0-2dcc895affbd'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:32:47.222084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 16c75b0b-41a7-42d6-b407-1b467eca6d71 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:47.299287 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 16c75b0b-41a7-42d6-b407-1b467eca6d71 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:32:47.305194 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 16c75b0b-41a7-42d6-b407-1b467eca6d71 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:47.305718 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:47.312550 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 46434) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:32:47.483073 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:47.505438 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 16c75b0b-41a7-42d6-b407-1b467eca6d71, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=16c75b0b-41a7-42d6-b407-1b467eca6d71,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:32:47.510599 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:47.513142 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:32:47.519989 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-3334942b-e5c5-4f41-baeb-451cab0bb23a admin admin] 10.222.0.25 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.2049906
Jun 02 16:32:47.617514 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=16c75b0b-41a7-42d6-b407-1b467eca6d71,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:32:47.623047 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:32:49.181097 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 16c75b0b-41a7-42d6-b407-1b467eca6d71 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:32:49.261524 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 16c75b0b-41a7-42d6-b407-1b467eca6d71 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:32:49.261954 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:55.813685 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-018defe2-6036-43ee-b52a-187e99f0008c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:58.467831 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5f7cbc2b-55e3-4458-979f-10b36560e2f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:32:58.769045 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:00.132400 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:01.787766 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:21.531156 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:33:25.792560 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba4f0f86-a39c-4fe2-843e-d9d73a6ff231 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:28.446105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-559cbf7e-6259-4dfa-ac89-7db788e38df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:28.762660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:30.151042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:31.795450 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:55.782406 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-99e5a536-3e0a-429d-9db1-dda8c1fb3bab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:58.441448 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e0415bc6-36c4-4638-94aa-ed60e2043b37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:33:58.530234 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:33:58.751236 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:00.146393 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:01.787681 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:25.778396 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0189bd98-873e-4c8f-b446-f1c28ea23060 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:26.771368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47002) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:26.843682 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.pecan_wsgi.hooks.translation [None req-98135121-1e71-41ca-86bd-fbcf459bd1b2 admin admin] GET failed (client error): The resource could not be found.
Jun 02 16:34:26.844183 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-98135121-1e71-41ca-86bd-fbcf459bd1b2 admin admin] Synchronizing usage tracker for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:network {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:34:26.865765 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-98135121-1e71-41ca-86bd-fbcf459bd1b2 admin admin] Unset dirty status for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:network {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:34:26.866871 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-98135121-1e71-41ca-86bd-fbcf459bd1b2 admin admin] 10.222.0.25 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0942481
Jun 02 16:34:27.013480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fc60c52-184b-4b27-a158-2d4e3bfff405 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:27.014876 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-5fc60c52-184b-4b27-a158-2d4e3bfff405 admin admin] 10.222.0.25 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1421289
Jun 02 16:34:28.446166 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-eacd280e-62d8-4c55-a95c-60a0f3d823bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:28.748392 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:29.204586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47012) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:29.324797 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b81784d-8e3f-4ef1-bba0-dc1f95ec89c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:29.325364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7b81784d-8e3f-4ef1-bba0-dc1f95ec89c9 admin admin] Synchronizing usage tracker for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:subnet {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:34:29.343883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7b81784d-8e3f-4ef1-bba0-dc1f95ec89c9 admin admin] Unset dirty status for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:subnet {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:34:29.345068 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7b81784d-8e3f-4ef1-bba0-dc1f95ec89c9 admin admin] 10.222.0.25 "GET /v2.0/subnets/6fb54b9e-12cf-4b58-805e-29e94cef493e HTTP/1.1" status: 200  len: 849 time: 0.1393991
Jun 02 16:34:29.354718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:34:29.517400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Notify callbacks [] for subnet, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:29.706509 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769112668097'] for subnet, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:29.711736 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:34:29.753071 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:29.753672 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:29.755443 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] 10.222.0.25 "PUT /v2.0/subnets/6fb54b9e-12cf-4b58-805e-29e94cef493e HTTP/1.1" status: 200  len: 868 time: 0.4041841
Jun 02 16:34:29.768273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84bec150-8582-4b1b-9234-8934b8a5f4df None None] Network 8dd70fab-286c-4cd6-abfc-3ae272d12e00 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:34:29.780560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6fb54b9e-12cf-4b58-805e-29e94cef493e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:34:29.788873 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.789405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.789648 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.789944 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.790262 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.790592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.790913 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.791230 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.791543 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.791853 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.792166 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.792474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:34:29.797034 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1ff1d02e-91c0-42cb-a66d-1975c5151e80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:34:30.141171 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:30.255813 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-5cc3d4bc-431f-41aa-9def-f145e20c1425 None None] Provisioning complete for port 192489a8-31c2-4cb5-a016-86a46c47c257 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:34:30.256181 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5cc3d4bc-431f-41aa-9def-f145e20c1425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:30.383139 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-5cc3d4bc-431f-41aa-9def-f145e20c1425 None None] Provisioning complete for port 3f3c19c1-6d38-44a2-b46c-cf4e364c1083 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:34:30.383457 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5cc3d4bc-431f-41aa-9def-f145e20c1425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:31.792263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:31.909993 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47022) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:32.096442 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2af3c7ea-5e3d-4ad0-b970-73a3905f79bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:32.096903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2af3c7ea-5e3d-4ad0-b970-73a3905f79bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:32.098471 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2af3c7ea-5e3d-4ad0-b970-73a3905f79bf admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1875341
Jun 02 16:34:34.214326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47030) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:34.410510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfa33b5f-636e-47ee-af8e-7538122ebe74 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:34.410971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfa33b5f-636e-47ee-af8e-7538122ebe74 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:34.412489 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bfa33b5f-636e-47ee-af8e-7538122ebe74 admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1972256
Jun 02 16:34:35.530046 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:34:36.525518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47038) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:36.712459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39a8fc52-2484-47e7-b444-86564502ed5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:36.713762 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-39a8fc52-2484-47e7-b444-86564502ed5c admin admin] 10.222.0.25 "GET /v2.0/networks/111563ce-426b-47b0-ac88-407bffa30df5 HTTP/1.1" status: 200  len: 886 time: 0.1868894
Jun 02 16:34:38.857898 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47046) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:39.040447 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f5feced-7979-482a-a48a-df80388d040e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:39.041774 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2f5feced-7979-482a-a48a-df80388d040e admin admin] 10.222.0.25 "GET /v2.0/networks/8dd70fab-286c-4cd6-abfc-3ae272d12e00 HTTP/1.1" status: 200  len: 869 time: 0.1828752
Jun 02 16:34:41.204252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47054) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:41.329432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47e301f8-37d4-4e14-ab6d-61885fa0ce88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:41.329919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47e301f8-37d4-4e14-ab6d-61885fa0ce88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:41.331440 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-47e301f8-37d4-4e14-ab6d-61885fa0ce88 admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1260288
Jun 02 16:34:43.451305 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47062) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:43.567628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd342fe9-f97b-452a-a14a-ff583af1c18d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:43.568085 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd342fe9-f97b-452a-a14a-ff583af1c18d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:43.569590 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-dd342fe9-f97b-452a-a14a-ff583af1c18d admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1172879
Jun 02 16:34:45.745482 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47070) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:45.865109 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b93e498-7cc0-459c-be32-987bf4bf1eb7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:45.866571 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4b93e498-7cc0-459c-be32-987bf4bf1eb7 admin admin] 10.222.0.25 "GET /v2.0/subnets/6fb54b9e-12cf-4b58-805e-29e94cef493e HTTP/1.1" status: 200  len: 868 time: 0.1200860
Jun 02 16:34:48.062229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47078) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:34:48.168180 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d093b4a0-ef7d-40d4-b813-52ac9ba9693b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:34:48.169535 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d093b4a0-ef7d-40d4-b813-52ac9ba9693b admin admin] 10.222.0.25 "GET /v2.0/subnets/7e7273ca-7a6e-4dbc-a88a-c692752bdd51 HTTP/1.1" status: 200  len: 816 time: 0.1063356
Jun 02 16:34:55.775308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e6ed02b4-be55-4714-9b39-08d98eb97eb1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:58.449968 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5873dd4a-eea9-47eb-9683-538a844a2180 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:34:58.746187 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:00.144471 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:01.794042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:11.755441 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47122) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:35:11.807314 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [None req-e605ef1c-ea8f-4ed5-ad24-4c965b693686 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98278) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:35:11.808328 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e605ef1c-ea8f-4ed5-ad24-4c965b693686 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0518966
Jun 02 16:35:12.529195 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:35:14.040153 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47130) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:35:14.115295 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a7051de-88b3-472c-9244-c0c8324cbda8 admin admin] GET failed (client error): The resource could not be found.
Jun 02 16:35:14.116643 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2a7051de-88b3-472c-9244-c0c8324cbda8 admin admin] 10.222.0.25 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0752716
Jun 02 16:35:14.246362 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64149728-c1a3-4f16-acf8-19c257b255d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:35:14.247743 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-64149728-c1a3-4f16-acf8-19c257b255d8 admin admin] 10.222.0.25 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1271350
Jun 02 16:35:16.387350 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47138) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:35:16.444521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:35:16.449620 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:35:16.460126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:35:16.473034 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Made reservation on behalf of 36db871ce425411caa9e6f27cd86ee15 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:35:16.475474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:16.563147 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING neutron.services.revisions.revision_plugin [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f9b7cba52b0] {project_id='36db871ce425411caa9e6f27cd86ee15', id='adef42ff-81ac-4a8c-b121-5f44cc560df1', target_tenant='*', action='access_as_shared', object_id='df15a956-c901-4c9d-90c9-65fb2e952f5c'}> to bump revision.
Jun 02 16:35:16.577439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] vlan segment allocate from pool success with {'vlan_id': 663, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:35:16.588285 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8769112582732', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:16.588872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f9b7d72a4c0> segment precommit_create {{(pid=98278) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 02 16:35:16.589284 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Added segment 342a2186-2b87-4389-8067-dddb1c928cda of type vlan for network df15a956-c901-4c9d-90c9-65fb2e952f5c
Jun 02 16:35:16.627793 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:16.667371 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:16.668751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:35:16.669317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:16.672523 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:35:16.763642 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3751447
Jun 02 16:35:16.771588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Pushing event updated for resources: {'Network': ['ID=df15a956-c901-4c9d-90c9-65fb2e952f5c,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:35:16.775276 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:35:16.782988 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network df15a956-c901-4c9d-90c9-65fb2e952f5c details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:35:18.907985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47146) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:35:18.977497 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.pecan_wsgi.hooks.translation [None req-e51b65bf-1101-4bba-b7be-5ff6bed1be23 admin admin] GET failed (client error): The resource could not be found.
Jun 02 16:35:18.978116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e51b65bf-1101-4bba-b7be-5ff6bed1be23 admin admin] Synchronizing usage tracker for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:35:18.995764 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e51b65bf-1101-4bba-b7be-5ff6bed1be23 admin admin] Unset dirty status for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:35:18.996882 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e51b65bf-1101-4bba-b7be-5ff6bed1be23 admin admin] 10.222.0.25 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0876255
Jun 02 16:35:19.111816 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d2fad5f-04d1-4ef9-97ff-9f8f0a4378b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:35:19.113205 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1d2fad5f-04d1-4ef9-97ff-9f8f0a4378b0 admin admin] 10.222.0.25 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1117647
Jun 02 16:35:19.126304 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c', 'ip_version': 4, 'name': 'shared-subnet'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:35:19.131116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:35:19.140995 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:35:19.150974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Made reservation on behalf of 36db871ce425411caa9e6f27cd86ee15 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:35:19.153541 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:19.550080 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:19.553561 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:35:19.665453 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7571ff92-bbfe-47fd-9d8a-fead904d9807,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:35:19.669930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:35:19.678898 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Checking segment: {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:35:19.679345 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Network hostable DHCP agents. Network: df15a956-c901-4c9d-90c9-65fb2e952f5c, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:35:19.698200 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Network df15a956-c901-4c9d-90c9-65fb2e952f5c is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:35:19.707675 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, df15a956-c901-4c9d-90c9-65fb2e952f5c) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:35:19.711935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:35:19.712510 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:19.716631 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71b191a7-c955-4805-ad32-112e48bd2b90 None None] Network df15a956-c901-4c9d-90c9-65fb2e952f5c requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:35:19.740155 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6198647
Jun 02 16:35:19.939400 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-df15a956-c901-4c9d-90c9-65fb2e952f5c', 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c', 'tenant_id': '36db871ce425411caa9e6f27cd86ee15', 'fixed_ips': [{'subnet_id': '7571ff92-bbfe-47fd-9d8a-fead904d9807'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:35:19.940547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.102794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Allocated IP 192.168.233.2 (df15a956-c901-4c9d-90c9-65fb2e952f5c/7571ff92-bbfe-47fd-9d8a-fead904d9807/b51d74a8-9035-48bc-993c-f8c5fcbb3234) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:35:20.342609 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.354314 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Transition to ACTIVE for port object b51d74a8-9035-48bc-993c-f8c5fcbb3234 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:35:20.376216 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Transition to ACTIVE for port object b51d74a8-9035-48bc-993c-f8c5fcbb3234 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:35:20.385632 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.390512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:35:20.456223 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Network df15a956-c901-4c9d-90c9-65fb2e952f5c is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:35:20.459744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:35:20.462145 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Pushing event updated for resources: {'Port': ['ID=b51d74a8-9035-48bc-993c-f8c5fcbb3234,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:35:20.464012 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:35:20.473211 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.473566 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.473912 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.474241 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.474543 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.474880 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.475923 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.475923 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.475923 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.476235 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.476825 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.476825 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:35:20.503889 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:35:20.566412 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Attempting to bind port b51d74a8-9035-48bc-993c-f8c5fcbb3234 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:35:20.566739 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Attempting to bind port b51d74a8-9035-48bc-993c-f8c5fcbb3234 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:35:20.567125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Attempting to bind port b51d74a8-9035-48bc-993c-f8c5fcbb3234 on network df15a956-c901-4c9d-90c9-65fb2e952f5c {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:35:20.572655 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 34, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:35:20.573018 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Checking segment: {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:35:20.573418 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.573832 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Bound using segment: {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:35:20.574300 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Bound port: b51d74a8-9035-48bc-993c-f8c5fcbb3234, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:35:20.574660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.664458 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] For port b51d74a8-9035-48bc-993c-f8c5fcbb3234, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:35:20.668338 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] For port b51d74a8-9035-48bc-993c-f8c5fcbb3234, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=b51d74a8-9035-48bc-993c-f8c5fcbb3234,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:35:20.672875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:20.677135 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:35:20.755489 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Pushing event updated for resources: {'Port': ['ID=b51d74a8-9035-48bc-993c-f8c5fcbb3234,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:35:20.786405 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:35:21.331303 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b51d74a8-9035-48bc-993c-f8c5fcbb3234 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:35:21.417511 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port b51d74a8-9035-48bc-993c-f8c5fcbb3234 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:35:21.598969 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeebff12-a27d-4c7a-bbc4-0e4fa09dfa28 None None] Network df15a956-c901-4c9d-90c9-65fb2e952f5c requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:35:21.723759 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Provisioning for port b51d74a8-9035-48bc-993c-f8c5fcbb3234 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:35:21.735217 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Provisioning complete for port b51d74a8-9035-48bc-993c-f8c5fcbb3234 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:35:21.735488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:21.954282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:21.991397 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] For port b51d74a8-9035-48bc-993c-f8c5fcbb3234, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=b51d74a8-9035-48bc-993c-f8c5fcbb3234,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:35:21.998377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:22.002585 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:35:22.078410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Pushing event updated for resources: {'Port': ['ID=b51d74a8-9035-48bc-993c-f8c5fcbb3234,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:35:22.083110 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:35:22.222569 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e084daa6-a7e8-4fa3-a9bc-ad8890bb1e5c None None] Provisioning complete for port b51d74a8-9035-48bc-993c-f8c5fcbb3234 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:35:22.222828 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e084daa6-a7e8-4fa3-a9bc-ad8890bb1e5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:23.299956 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b51d74a8-9035-48bc-993c-f8c5fcbb3234 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:35:23.367199 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port b51d74a8-9035-48bc-993c-f8c5fcbb3234 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:35:23.367552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:25.772794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fc59bdbf-7aab-4551-a430-78a2dd01c0ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:28.454783 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9bf60c5a-5027-4f93-99a9-c32626c1551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:28.744710 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:30.147666 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:31.797165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:49.528627 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:35:55.771053 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-30a02f4a-869f-4536-ab01-d9877d49f70f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:58.461562 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b057cac8-512b-4b96-8620-f43ddf8309a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:35:58.741872 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:00.196296 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:01.811384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:25.768858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c3321fc8-384d-4b3c-8ac5-7a8775bfe3fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:26.528686 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:36:27.622775 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47200) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:36:27.629111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [None req-2e084dcf-8c84-4d02-a115-72d21e2c4cdc tempest-verify_tempest_config-1212838523 tempest-verify_tempest_config-1212838523-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98278) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:36:27.630150 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2e084dcf-8c84-4d02-a115-72d21e2c4cdc tempest-verify_tempest_config-1212838523 tempest-verify_tempest_config-1212838523-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0062962
Jun 02 16:36:27.972042 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47218) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:36:28.120360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.135709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:36:28.139864 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Usage tracker for resource:security_group_rule and tenant:e5c0b64d8edc4e93ba01580ce176c03a is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:36:28.143270 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:36:28.149017 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:36:28.253785 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.258298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.265627 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:36:28.311787 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e5c0b64d8edc4e93ba01580ce176c03a&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3385594
Jun 02 16:36:28.312663 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0bf1450-a788-4f4a-806f-05188b2968a3,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:36:28.314866 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47222) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:36:28.320560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.320903 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.321237 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.321592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.321904 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.322257 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.322567 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.322863 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.323189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.323502 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.323794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.324116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.329196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:36:28.380496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.407331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.457799 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ed81778a-b978-41a6-a4c3-69579c88698a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.517683 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.522115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:36:28.535336 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0bf1450-a788-4f4a-806f-05188b2968a3,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:36:28.543665 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:28.544766 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a0bf1450-a788-4f4a-806f-05188b2968a3 HTTP/1.1" status: 204  len: 168 time: 0.2285368
Jun 02 16:36:28.546437 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.546770 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.547097 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.547423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.547736 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.548185 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.548453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.548770 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.549081 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.549386 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.549815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.550027 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:36:28.553990 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:36:28.743728 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:30.153624 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:31.803862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:55.764073 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4a9140a1-be98-46de-a72b-df258290c572 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:58.455715 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9046e09d-46be-4260-aa35-bf12065a51a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:36:58.738889 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:00.157875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:01.808261 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:03.528240 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:37:25.760603 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b94647a0-cb3d-4b10-83ee-f9d666891332 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:28.450590 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c8242397-e42a-49ea-826b-f5c536ca878b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:28.748520 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:30.163547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:31.814726 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:40.532178 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 5 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:37:55.764914 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fbbab377-f8ba-473d-af91-139b5f9e5df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:58.459213 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1a498223-309a-4414-a51b-ff7becacff7d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:37:58.745699 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:00.165866 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:01.816041 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:03.706066 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877'] for agent, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:08.058913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47276) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:38:08.202117 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ef0133e4-f3e7-441b-bcdc-5631d322e6a4 admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1420038
Jun 02 16:38:10.298793 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47286) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:38:10.357828 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ddb4ca05-3df3-4868-a4bd-97f0f5a3cc9f admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0577331
Jun 02 16:38:17.533750 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:38:25.774824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50e3d91a-5221-42e3-b2de-8c3940d70eb9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:28.453502 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-2a6077c7-7061-408a-9418-896548a50019 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:28.740029 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:30.170143 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:31.819460 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:33.681917 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:54.533010 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:38:55.773111 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ae175b3d-dae6-4029-ad6e-1a418f8b5490 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:58.457784 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-661b0c2a-a39b-42cf-a1ed-ddd195bf4c26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:38:58.744988 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:00.173094 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:01.822820 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:03.706545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:25.766263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-290752e5-04c3-461d-a5fe-c2942c985a64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:28.462672 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e115e624-8560-4121-89f1-42250a077cbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:28.753384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:30.170646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:31.534930 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:39:31.828127 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:33.698987 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:34.865117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47444) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:35.065728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47456) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:35.286037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-network', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:35.291119 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.295260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Usage tracker for resource:network and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.299254 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.305462 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.320703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Made reservation on behalf of 545e33df5ea046a0bb2be1fb482f75fb for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:35.323292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.342755 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-839443217-network', 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:35.348893 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.351081 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.363079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Usage tracker for resource:network and tenant:a3af7d82fba84269a3596d85213ae5e2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.367218 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.374864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.377131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.380869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.384651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.392682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.406733 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:35.409251 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.440447 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.461646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.472899 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Usage tracker for resource:security_group_rule and tenant:a3af7d82fba84269a3596d85213ae5e2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.476763 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.487108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.520479 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47482) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:35.569781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.577245 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.585375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:35.609943 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] vlan segment allocate from pool success with {'vlan_id': 670, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:39:35.644916 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.645258 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Added segment 9b9e4bab-a22b-478f-b1cb-4c73b58bba52 of type vlan for network 72edfd0c-8b13-49df-90c4-bff53519faeb
Jun 02 16:39:35.662468 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=058e1108-bcd2-4e6f-a81d-21bf1773304c,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:35.672695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.687255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.687918 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.688402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.688881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.689418 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.689957 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.690516 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.690653 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.690930 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.691397 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.691717 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.692032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Tracked resource versions report:
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]: pushed versions:
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]: {   'AddressGroup': {'1.2'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'ConntrackHelper': {'1.0'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Log': {'1.0'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Network': {'1.1'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Port': {'1.7'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'PortForwarding': {'1.2'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'QosPolicy': {'1.8'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SecurityGroup': {'1.4'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'SubPort': {'1.0'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Subnet': {'1.1'},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     'Trunk': {'1.1'}}
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]: consumer versions:
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     HyperV agent@hv-cinder-79402: {},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Log': '1.0',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Network': '1.1',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Port': '1.7',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'PortForwarding': '1.2',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'QosPolicy': '1.8',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SecurityGroup': '1.4',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'SubPort': '1.0',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Subnet': '1.1',
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:                                                      'Trunk': '1.1'}}
Jun 02 16:39:35.693099 dv-cinder-794021-2-iscsi neutron-server[98277]:  {{(pid=98277) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:39:35.695692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.699381 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:35.705360 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:35.714712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.732787 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] vlan segment allocate from pool success with {'vlan_id': 679, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:39:35.737851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1614393703-network', 'tenant_id': 'a940e65f547649a6b5dbd349c6239cbc'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:35.744009 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.750681 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Usage tracker for resource:network and tenant:a940e65f547649a6b5dbd349c6239cbc is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.757889 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.762996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75bcef4b-f728-4233-ad34-9ba33c8ff51d,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:35.765913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.766260 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Added segment 59c8b886-b320-4458-b689-37f87c2bd654 of type vlan for network 87543dfa-9cef-40b2-b537-1f95fcf2b066
Jun 02 16:39:35.766545 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.774077 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:35.785144 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Made reservation on behalf of a940e65f547649a6b5dbd349c6239cbc for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:35.789120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.800517 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.803517 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:35.804087 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.805154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.808430 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:35.811876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-105ea0b2-db16-4426-b6a6-cfd4f6e2446e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:35.821845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.827225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Usage tracker for resource:security_group_rule and tenant:a940e65f547649a6b5dbd349c6239cbc is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.831706 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.839282 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:35.939795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Pushing event updated for resources: {'Network': ['ID=72edfd0c-8b13-49df-90c4-bff53519faeb,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:35.946071 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 1.0798311
Jun 02 16:39:35.947730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47506) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:35.948507 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:35.953128 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 72edfd0c-8b13-49df-90c4-bff53519faeb details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:39:35.953727 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Request body: {'subnet': {'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-subnet', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:35.958258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:35.962139 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Usage tracker for resource:subnet and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:35.965001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:35.970905 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:36.000752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.007182 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.016481 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:36.019973 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Made reservation on behalf of 545e33df5ea046a0bb2be1fb482f75fb for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:36.022842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.042026 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] vlan segment allocate from pool success with {'vlan_id': 655, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:39:36.072366 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c0fd46d-f333-49cc-8e5f-1a09d571462c,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:36.075900 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.076845 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Added segment a06ec11a-1aa9-49e2-824a-cb70c50736bf of type vlan for network 8d1e36c6-d295-4363-85e5-dce458b299cc
Jun 02 16:39:36.091751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.092439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.092983 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.093694 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.094168 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.094731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.095369 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.095884 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.097060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.097554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.098064 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.098759 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Tracked resource versions report:
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]: pushed versions:
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]: {   'AddressGroup': {'1.2'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'ConntrackHelper': {'1.0'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Log': {'1.0'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Network': {'1.1'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Port': {'1.7'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'PortForwarding': {'1.2'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'QosPolicy': {'1.8'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SecurityGroup': {'1.4'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'SubPort': {'1.0'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Subnet': {'1.1'},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     'Trunk': {'1.1'}}
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]: consumer versions:
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     HyperV agent@hv-cinder-79402: {},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Log': '1.0',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Network': '1.1',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Port': '1.7',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'PortForwarding': '1.2',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'QosPolicy': '1.8',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SecurityGroup': '1.4',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'SubPort': '1.0',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Subnet': '1.1',
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:                                                      'Trunk': '1.1'}}
Jun 02 16:39:36.099986 dv-cinder-794021-2-iscsi neutron-server[98278]:  {{(pid=98278) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:39:36.121376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:36.131660 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.155856 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:36.156607 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.163453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1dee1e54-a29b-4dbc-a790-ab7069944af4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:36.170766 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.209968 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.211478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:36.212050 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.235040 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:36.289662 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.2227664
Jun 02 16:39:36.292252 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47524) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:36.329429 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Pushing event updated for resources: {'Network': ['ID=8d1e36c6-d295-4363-85e5-dce458b299cc,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:36.334832 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:36.341537 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Request body: {'subnet': {'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-839443217-subnet', 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:36.344221 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 8d1e36c6-d295-4363-85e5-dce458b299cc details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:39:36.352621 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:36.356689 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.8350446
Jun 02 16:39:36.357210 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Pushing event updated for resources: {'Network': ['ID=87543dfa-9cef-40b2-b537-1f95fcf2b066,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:36.360629 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47526) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:36.365454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:36.366939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Usage tracker for resource:subnet and tenant:a3af7d82fba84269a3596d85213ae5e2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:36.371251 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:36.373023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Request body: {'subnet': {'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1614393703-subnet', 'tenant_id': 'a940e65f547649a6b5dbd349c6239cbc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:36.374997 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:39:36.382166 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:36.389194 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47528) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:36.396051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Usage tracker for resource:subnet and tenant:a940e65f547649a6b5dbd349c6239cbc is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:36.402302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:36.404108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:36.419170 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:36.433329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:36.437258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.441488 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Made reservation on behalf of a940e65f547649a6b5dbd349c6239cbc for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:36.444100 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.743694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.751749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:36.813140 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:36.817291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:36.877841 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Checking segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:36.878336 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Network hostable DHCP agents. Network: 72edfd0c-8b13-49df-90c4-bff53519faeb, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:39:36.911795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-851761837-network', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:36.916193 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:36.920774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Usage tracker for resource:network and tenant:2a331932fba240f7a0fbb0b93203268c is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:36.923327 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:36.929553 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:36.937719 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:39:36.948789 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.957302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-88ed912b-245b-4203-bb51-d2ae8c59cda7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:36.961874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Made reservation on behalf of 2a331932fba240f7a0fbb0b93203268c for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:36.964517 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.986291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 72edfd0c-8b13-49df-90c4-bff53519faeb) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:36.991152 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:36.996270 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63d0bac5-05e9-462c-a2ac-cd129772d1d6 None None] Network 72edfd0c-8b13-49df-90c4-bff53519faeb requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:37.012846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:37.013574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.033529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:37.064271 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Usage tracker for resource:security_group_rule and tenant:2a331932fba240f7a0fbb0b93203268c is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:37.072697 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:37.083829 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:37.113169 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Checking segment: {'id': 'a06ec11a-1aa9-49e2-824a-cb70c50736bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:37.113517 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Network hostable DHCP agents. Network: 8d1e36c6-d295-4363-85e5-dce458b299cc, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:39:37.137190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Pushing event updated for resources: {'Subnet': ['ID=caf8e91b-8d46-4a47-a396-8ce21c092e9d,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:37.142423 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:37.152346 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.2027948
Jun 02 16:39:37.153131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47552) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:37.164196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Network 8d1e36c6-d295-4363-85e5-dce458b299cc is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:39:37.178702 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:37.183757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 8d1e36c6-d295-4363-85e5-dce458b299cc) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:37.195745 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:37.196335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.200243 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:37.225798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Usage tracker for resource:router and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:37.239215 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:37.256104 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 0.8929231
Jun 02 16:39:37.267747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:37.286633 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10cba763-5bee-446a-8275-3b29bdcb6250 None None] Network 8d1e36c6-d295-4363-85e5-dce458b299cc requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:37.438486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.439858 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.536301 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.602238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.619887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:37.727070 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-752bbb5c-f172-4dc7-87c1-b70f6454898c None None] Network 8d1e36c6-d295-4363-85e5-dce458b299cc requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:37.768629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:37.886241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ef97cdf-badb-4182-b404-c9d480fe5811,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:37.922757 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:38.030064 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-72edfd0c-8b13-49df-90c4-bff53519faeb', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:39:38.031463 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.094859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] vlan segment allocate from pool success with {'vlan_id': 682, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:39:38.245888 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Allocated IP 172.20.0.2 (72edfd0c-8b13-49df-90c4-bff53519faeb/5fa6f4a1-7c91-4d10-977a-c26f520b3ec0/f111f4c1-2a68-4074-82b3-e8424102bb07) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:38.316246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.316590 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Added segment 27a32301-de09-4cde-a3f0-526d03f25ea3 of type vlan for network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef
Jun 02 16:39:38.346748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.357224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.390806 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-64afa15b-e611-40fc-8b0d-ad2addfa6992 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:38.513479 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Checking segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:38.513950 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Network hostable DHCP agents. Network: 87543dfa-9cef-40b2-b537-1f95fcf2b066, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:39:38.527473 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.536527 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47624) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:38.542119 dv-cinder-794021-2-iscsi neutron-server[98278]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 02 16:39:38.568366 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.575120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Pushing event updated for resources: {'Subnet': ['ID=409c7043-b3b6-42f7-90b5-f7db5d717e70,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:38.588337 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:38.607707 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Transition to ACTIVE for port object f111f4c1-2a68-4074-82b3-e8424102bb07 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:38.631554 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Transition to ACTIVE for port object f111f4c1-2a68-4074-82b3-e8424102bb07 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:38.636291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:39:38.642550 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.656327 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:38.658863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 87543dfa-9cef-40b2-b537-1f95fcf2b066) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:38.662072 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.665547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:38.666263 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.678487 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:38.679130 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:38.703812 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:38.745706 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 2.4012861
Jun 02 16:39:38.749300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-f146952d-9f6b-44f4-9c08-c4385a4bf087 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:38.750354 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-f146952d-9f6b-44f4-9c08-c4385a4bf087 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Synchronizing usage tracker for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:38.784003 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-f146952d-9f6b-44f4-9c08-c4385a4bf087 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Unset dirty status for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:38.785732 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-f146952d-9f6b-44f4-9c08-c4385a4bf087 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/networks?id=8d1e36c6-d295-4363-85e5-dce458b299cc HTTP/1.1" status: 200  len: 812 time: 0.2475173
Jun 02 16:39:38.808529 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75e3838b-b19d-4f75-bb60-69e250f80eeb None None] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:38.824740 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-e09143e4-863e-46e9-bd67-ee0524c8704d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/quotas/a940e65f547649a6b5dbd349c6239cbc HTTP/1.1" status: 200  len: 375 time: 0.0310314
Jun 02 16:39:38.827572 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 2.4364662
Jun 02 16:39:38.831162 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47636) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:38.847411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Request body: {'subnet': {'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-subnet', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:38.915871 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Pushing event updated for resources: {'Port': ['ID=f111f4c1-2a68-4074-82b3-e8424102bb07,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:38.928151 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:38.942291 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.943544 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.944319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.944319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.945114 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.946934 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.947997 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.947997 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.951516 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.952285 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.953141 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.953475 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Tracked resource versions report:
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]: pushed versions:
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]: {   'AddressGroup': {'1.2'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'ConntrackHelper': {'1.0'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Log': {'1.0'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Network': {'1.1'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Port': {'1.7'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'PortForwarding': {'1.2'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'QosPolicy': {'1.8'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SecurityGroup': {'1.4'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'SubPort': {'1.0'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Subnet': {'1.1'},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     'Trunk': {'1.1'}}
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]: consumer versions:
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     HyperV agent@hv-cinder-79402: {},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Log': '1.0',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Network': '1.1',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Port': '1.7',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'PortForwarding': '1.2',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'QosPolicy': '1.8',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SecurityGroup': '1.4',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'SubPort': '1.0',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Subnet': '1.1',
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:                                                      'Trunk': '1.1'}}
Jun 02 16:39:38.957404 dv-cinder-794021-2-iscsi neutron-server[98279]:  {{(pid=98279) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:39:38.961205 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Pushing event updated for resources: {'Network': ['ID=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:38.962610 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-189c81ff-6616-4061-ae3e-5bd9b6426189 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a940e65f547649a6b5dbd349c6239cbc&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1361930
Jun 02 16:39:38.964810 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:38.966872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Usage tracker for resource:subnet and tenant:2a331932fba240f7a0fbb0b93203268c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:38.974143 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:38.984408 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:38.989624 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:38.997408 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:39.001579 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:39.004796 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:39:39.012420 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Made reservation on behalf of 2a331932fba240f7a0fbb0b93203268c for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:39.018827 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.130809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:39.185956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47660) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:39.364009 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Attempting to bind port f111f4c1-2a68-4074-82b3-e8424102bb07 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:39:39.364552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Attempting to bind port f111f4c1-2a68-4074-82b3-e8424102bb07 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:39:39.364763 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Attempting to bind port f111f4c1-2a68-4074-82b3-e8424102bb07 on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:39:39.417308 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.424312 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:39:39.424765 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Checking segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:39.425230 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.425717 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Bound using segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:39:39.426282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Bound port: f111f4c1-2a68-4074-82b3-e8424102bb07, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:39:39.426661 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.444422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-0ef1e8e8-305a-458d-8aaa-bb3e499114d2 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98278) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:39:39.445432 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-0ef1e8e8-305a-458d-8aaa-bb3e499114d2 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1303298
Jun 02 16:39:39.469561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.476544 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:39.496090 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Usage tracker for resource:security_group_rule and tenant:2eab787cd5454f6db3e4d086cf010ae6 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:39.500793 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:39.506329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.512658 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:39.636825 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64ef2e5f-561d-4a03-b1ef-d47e6092d422 None None] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:39.658349 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] For port f111f4c1-2a68-4074-82b3-e8424102bb07, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:39:39.682602 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] For port f111f4c1-2a68-4074-82b3-e8424102bb07, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=f111f4c1-2a68-4074-82b3-e8424102bb07,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:39:39.740195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.748627 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47694) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:39.751471 dv-cinder-794021-2-iscsi neutron-server[98277]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 02 16:39:39.751696 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:39.781549 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Allocated IP 172.27.0.104 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/5b4b432d-d952-49ef-93f0-73b1c2062489) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:39.847991 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-4108370f-b06b-4fc0-b20d-15b5d22ed975 service neutron] 10.222.0.25 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3921969
Jun 02 16:39:39.917717 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Pushing event updated for resources: {'Port': ['ID=f111f4c1-2a68-4074-82b3-e8424102bb07,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:39.920473 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:39.932029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:39.956294 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.010948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:40.032834 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-20b614fa-766e-449e-bec7-ddffaa763239 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:40.033569 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-20b614fa-766e-449e-bec7-ddffaa763239 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:network {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:40.094735 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.097987 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-20b614fa-766e-449e-bec7-ddffaa763239 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:network {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:40.099197 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-20b614fa-766e-449e-bec7-ddffaa763239 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.3492956
Jun 02 16:39:40.124625 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-16ae82ed-ec70-4107-86b4-7f700aaded4e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/quotas/a3af7d82fba84269a3596d85213ae5e2 HTTP/1.1" status: 200  len: 375 time: 0.0179241
Jun 02 16:39:40.130579 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2eab787cd5454f6db3e4d086cf010ae6&name=default HTTP/1.1" status: 200  len: 2975 time: 0.9434626
Jun 02 16:39:40.132775 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47698) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:40.167220 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.174756 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-8ebc17bc-3aa4-450f-bb95-1c91132b1cda service neutron] 10.222.0.25 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2839463
Jun 02 16:39:40.179476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=225f5a3b-279a-43f5-92ba-e511d18dd853,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:40.186109 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:40.186600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-41b7a3f7-ff00-41e5-baef-220e9927839f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:40.234213 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-2017ec46-af54-482f-85da-54b501294736 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0897303
Jun 02 16:39:40.278224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.285433 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0181ac68-65a5-4b9a-9995-215bf77b5c32,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:40.285935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.288935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:40.289089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:40.297298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Checking segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:40.297684 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Network hostable DHCP agents. Network: 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:39:40.326120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:39:40.337181 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:40.342269 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:40.343090 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.350160 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7a20157-e12b-4c84-a8b5-384f1046de38 None None] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:40.383251 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:40.384523 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 855 time: 1.5507247
Jun 02 16:39:40.385695 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47712) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:40.389292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:40.391816 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:40.395653 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:40.405581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:40.410150 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Usage tracker for resource:router and tenant:2a331932fba240f7a0fbb0b93203268c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:40.413281 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:40.420806 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:40.435451 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.437525 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.460387 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.467155 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:40.482763 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Pushing event updated for resources: {'Port': ['ID=5b4b432d-d952-49ef-93f0-73b1c2062489,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:40.490040 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-b2df1f68-81dd-4983-975f-d1822898b86c service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:39:40.491292 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-b2df1f68-81dd-4983-975f-d1822898b86c service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1648786
Jun 02 16:39:40.537173 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:40.735501 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f105172-0d0b-4fc0-bff0-8973c2049ec8 None None] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:41.056339 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-79991ae2-2763-4d16-9c22-12af6ad42208 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5508206
Jun 02 16:39:41.077536 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.127002 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.151612 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-96a44d87-2dae-441b-858e-dcc26cbddb3d req-103dbb35-a8c8-4574-a105-5155f2cbb2ec tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1176834
Jun 02 16:39:41.169335 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b9414dfa-f6bb-440c-9b05-58e18d486e7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:41.247065 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.250527 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/225f5a3b-279a-43f5-92ba-e511d18dd853 HTTP/1.1" status: 204  len: 168 time: 1.1138494
Jun 02 16:39:41.250527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=225f5a3b-279a-43f5-92ba-e511d18dd853,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:41.282306 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:41.326256 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4ec4d5e-36c6-4b87-bfed-99aeabb0c437 None None] Network 72edfd0c-8b13-49df-90c4-bff53519faeb requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:39:41.537787 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.629367 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-b17042a8-1a04-40ef-8fd9-cb9ddb2859d4 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5719576
Jun 02 16:39:41.657859 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device f111f4c1-2a68-4074-82b3-e8424102bb07 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:41.707038 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e67bba40-1730-4fa3-b047-d590a4f9877e None None] Provisioning for port f111f4c1-2a68-4074-82b3-e8424102bb07 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:39:41.869091 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.918054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port f111f4c1-2a68-4074-82b3-e8424102bb07 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:39:41.928181 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:41.940074 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port f111f4c1-2a68-4074-82b3-e8424102bb07 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:41.941835 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.170758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47792) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:42.217179 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.259188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:42.266737 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Allocated IP 172.27.0.50 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/b982aaa4-941e-42c4-b4ad-f81777aafbd9) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:42.271328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Usage tracker for resource:security_group_rule and tenant:cae7dacd583a4516b1cc613fedaa6233 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:42.285725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:42.296578 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:42.300609 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.328675 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.372845 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port f111f4c1-2a68-4074-82b3-e8424102bb07, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=f111f4c1-2a68-4074-82b3-e8424102bb07,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:39:42.379054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.389269 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:42.477458 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=f111f4c1-2a68-4074-82b3-e8424102bb07,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:42.492583 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:42.590060 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3adc381c-db60-488b-8573-f1729e45cd59 req-8a4e6c3e-b458-4e4d-8ecb-3c3790242ad8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.2904527
Jun 02 16:39:42.676209 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-60d22713-ca32-4d20-b56d-0f8cb84629c1 None None] Provisioning complete for port f111f4c1-2a68-4074-82b3-e8424102bb07 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:42.677875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-60d22713-ca32-4d20-b56d-0f8cb84629c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.810026 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81c26753-6513-4668-9bc4-98ee07a1bd0b req-ce514b00-1faa-4575-943a-91e5aa2885a2 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1773491
Jun 02 16:39:42.897393 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.951857 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.957448 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47834) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:42.957686 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.965164 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:42.976051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f3cff784-8231-4fa3-880d-e84842a2c1ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:42.999297 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98277) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:39:43.009789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:43.034927 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:43.036532 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:43.045710 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:43.050765 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Synchronizing usage tracker for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:43.167401 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=130f6e56-3d8d-4cfd-802c-ca4f03097dd4,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:43.186388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:43.199909 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.211526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Unset dirty status for tenant:36db871ce425411caa9e6f27cd86ee15 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:43.216197 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=cae7dacd583a4516b1cc613fedaa6233&name=default HTTP/1.1" status: 200  len: 2975 time: 1.0445025
Jun 02 16:39:43.219633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47844) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:43.251794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Pushing event updated for resources: {'Port': ['ID=b982aaa4-941e-42c4-b4ad-f81777aafbd9,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:43.262739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:43.277467 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:43.286253 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Usage tracker for resource:security_group_rule and tenant:f8abe748e7dc4b66971332c7d23d6e86 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:43.295921 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:43.322677 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:43.384406 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:39:43.399810 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:39:43.426433 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:43.427670 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c105cd0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:43.436750 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.438706 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 6.2761068
Jun 02 16:39:43.441550 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47848) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:43.478504 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.543257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device f111f4c1-2a68-4074-82b3-e8424102bb07 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:43.671567 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.676887 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port f111f4c1-2a68-4074-82b3-e8424102bb07 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:43.677562 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.730280 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.834380 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:43.886337 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.891933 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1f50c7df-0709-4771-9d74-e431f25918ae req-eb5d9476-4210-4326-a98a-a7cd0aa6c95e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.1122134
Jun 02 16:39:43.902470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:43.971733 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc3e-6dcf-444e-8c96-bcd3bb38c5cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:44.041385 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.070998 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f8abe748e7dc4b66971332c7d23d6e86&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1095088
Jun 02 16:39:44.075597 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 47862) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:44.085347 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e58b2f0a-dc11-4c40-a91d-28cd30a8d24e req-22bd2bd0-4f98-4e6b-9b57-d58149c0f825 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1019440
Jun 02 16:39:44.095060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cddb8a31-5ea7-475a-91f4-6d66ab624c4d,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:44.151183 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c105cd0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:41Z', 'revision_number': 3, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:44.155015 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:39:44.155526 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Updating router 0f4b3491-20d5-45fe-85b1-eae089a74e29 port 5b4b432d-d952-49ef-93f0-73b1c2062489 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:39:44.155889 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:44.162757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a1f6f4c9-3e36-48a9-be84-3036dbdcead0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.096s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:44.182267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=130f6e56-3d8d-4cfd-802c-ca4f03097dd4,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:44.189394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:44.211807 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.215579 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/130f6e56-3d8d-4cfd-802c-ca4f03097dd4 HTTP/1.1" status: 204  len: 168 time: 0.9623296
Jun 02 16:39:44.225311 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.239594 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.267171 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.323386 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.407233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.417899 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:44.432376 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cddb8a31-5ea7-475a-91f4-6d66ab624c4d,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:44.439749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:44.448225 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.449340 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cddb8a31-5ea7-475a-91f4-6d66ab624c4d HTTP/1.1" status: 204  len: 168 time: 0.3726218
Jun 02 16:39:44.522936 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.724812 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.741422 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Transition to ACTIVE for port object 5b4b432d-d952-49ef-93f0-73b1c2062489 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:44.749896 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Router aaae5f75-b61b-4f4d-8d83-298cf66986f0 is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98278) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:39:44.751527 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.758640 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:44.820413 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Allocated IP 172.20.0.1 (72edfd0c-8b13-49df-90c4-bff53519faeb/5fa6f4a1-7c91-4d10-977a-c26f520b3ec0/c812a3b1-038c-4274-8dfb-011532b44752) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:44.843072 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Attempting to bind port 5b4b432d-d952-49ef-93f0-73b1c2062489 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:39:44.843668 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Attempting to bind port 5b4b432d-d952-49ef-93f0-73b1c2062489 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:39:44.844217 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Attempting to bind port 5b4b432d-d952-49ef-93f0-73b1c2062489 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:39:44.857312 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:39:44.857990 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:44.858386 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.858799 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:39:44.859271 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Bound port: 5b4b432d-d952-49ef-93f0-73b1c2062489, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:39:44.859638 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:44.900257 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Pushing event updated for resources: {'Port': ['ID=5b4b432d-d952-49ef-93f0-73b1c2062489,revision_number=2']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:44.922345 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.923039 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.923765 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.924240 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.924724 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.925191 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.925692 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.926155 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.926647 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.927122 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.927880 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.928439 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Tracked resource versions report:
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]: pushed versions:
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]: {   'AddressGroup': {'1.2'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'ConntrackHelper': {'1.0'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Log': {'1.0'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Network': {'1.1'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Port': {'1.7'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'PortForwarding': {'1.2'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'QosPolicy': {'1.8'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SecurityGroup': {'1.4'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SecurityGroupRule': {'1.2'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'SubPort': {'1.0'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Subnet': {'1.1'},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     'Trunk': {'1.1'}}
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]: consumer versions:
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]: {   DHCP agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     HyperV agent@hv-cinder-79402: {},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     L3 agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     Metadata agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     Metering agent@dv-cinder-794021-2-iscsi: {},
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:     Open vSwitch agent@dv-cinder-794021-2-iscsi: {   'AddressGroup': '1.2',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'ConntrackHelper': '1.0',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Log': '1.0',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Network': '1.1',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Port': '1.7',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'PortForwarding': '1.2',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'QosPolicy': '1.8',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SecurityGroup': '1.4',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SecurityGroupRule': '1.2',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'SubPort': '1.0',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Subnet': '1.1',
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:                                                      'Trunk': '1.1'}}
Jun 02 16:39:44.930327 dv-cinder-794021-2-iscsi neutron-server[98280]:  {{(pid=98280) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 02 16:39:44.942044 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:45.011917 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] For port 5b4b432d-d952-49ef-93f0-73b1c2062489, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:39:45.016087 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] For port 5b4b432d-d952-49ef-93f0-73b1c2062489, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5b4b432d-d952-49ef-93f0-73b1c2062489,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:39:45.022888 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:45.035876 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:45.047088 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:45.060288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:39:45.073485 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Sync routers for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:39:45.082649 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Transition to ACTIVE for port object c812a3b1-038c-4274-8dfb-011532b44752 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:45.097106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:45.097874 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c251ca0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:45.108517 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Notify callbacks [] for router, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:45.110273 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 4.7183723
Jun 02 16:39:45.112945 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 47894) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:45.114584 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:45.130578 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:45.173738 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:45.174428 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c105cd0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:45.263400 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Pushing event updated for resources: {'Port': ['ID=5b4b432d-d952-49ef-93f0-73b1c2062489,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:45.266622 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:45.285972 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Pushing event updated for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:45.293932 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:45.299331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:45.301043 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:45.303902 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:45.304385 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:45.435873 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-60a8fa86-7a51-410a-8a57-1815aa596165 req-7feeb12e-ac1f-4ee5-bb01-773bc2b48a2f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.1917231
Jun 02 16:39:45.577862 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:45.595582 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:46.037959 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-48ac047d-98de-4ab4-a328-7c48eea20cf5 req-6acaf989-35f0-43c0-a271-dfc177ec4fbc tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.0825484
Jun 02 16:39:46.119885 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-11cf14bf-e8b4-40cc-a4b5-3abbbc7f6e23 None None] Provisioning for port c812a3b1-038c-4274-8dfb-011532b44752 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:39:46.161961 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c105cd0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:41Z', 'revision_number': 3, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:46.171233 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3172deb9-7f4d-4fe1-8f75-24dd7170649c None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:41Z', 'revision_number': 3, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:39:46.270550 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-11cf14bf-e8b4-40cc-a4b5-3abbbc7f6e23 None None] Provisioning complete for port c812a3b1-038c-4274-8dfb-011532b44752 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:46.270933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-11cf14bf-e8b4-40cc-a4b5-3abbbc7f6e23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:46.437115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:46.556381 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.20', 50709) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:46.732409 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-11cf14bf-e8b4-40cc-a4b5-3abbbc7f6e23 None None] Port c812a3b1-038c-4274-8dfb-011532b44752 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:39:46.774824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c251ca0>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:43Z', 'revision_number': 3, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:46.785865 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Checking router: aaae5f75-b61b-4f4d-8d83-298cf66986f0 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:39:46.786209 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Updating router aaae5f75-b61b-4f4d-8d83-298cf66986f0 port b982aaa4-941e-42c4-b4ad-f81777aafbd9 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:39:46.928158 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:46.969678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-196193d5-876d-42f8-ba27-72d7a3afaf5f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:46.972580 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-196193d5-876d-42f8-ba27-72d7a3afaf5f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.4047461
Jun 02 16:39:47.083210 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Request body: {'port': {'device_id': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'admin_state_up': True, 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:47.146854 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a54d2273-e022-4387-a227-b00e3a4fc364 req-fdc06b86-5f92-4616-ba6d-6e436cfa0a39 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.1668212
Jun 02 16:39:47.149376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:47.566859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.20', 50717) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:47.647208 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a750ebd-a785-4ad2-b78d-52c2c49fcb47 req-f3f9e875-9f60-46c2-b0c7-52789f2bdd0d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1254375
Jun 02 16:39:47.850902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Allocated IP 172.20.0.1 (1f2f7c0d-7d36-4292-bab6-39e7de3c95ef/0181ac68-65a5-4b9a-9995-215bf77b5c32/5e024a6b-65b5-4078-af70-6779bd688836) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:47.872534 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5b4b432d-d952-49ef-93f0-73b1c2062489 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:47.886682 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48026) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:47.953467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-73d37773-2967-4485-809a-d60c44c27f1e tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:47.955065 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-73d37773-2967-4485-809a-d60c44c27f1e tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.20 "GET /v2.0/networks?id=8d1e36c6-d295-4363-85e5-dce458b299cc HTTP/1.1" status: 200  len: 812 time: 0.3792326
Jun 02 16:39:47.956386 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:47.984299 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Transition to ACTIVE for port object b982aaa4-941e-42c4-b4ad-f81777aafbd9 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:48.000799 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Request body: {'port': {'device_id': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc', 'admin_state_up': True, 'tenant_id': 'a940e65f547649a6b5dbd349c6239cbc'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:48.000922 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.030525 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-fdfa90ec-e752-49bd-836a-a4ab73459108 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:48.089713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 5b4b432d-d952-49ef-93f0-73b1c2062489 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:39:48.125545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5b4b432d-d952-49ef-93f0-73b1c2062489 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:48.125988 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.173454 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Attempting to bind port b982aaa4-941e-42c4-b4ad-f81777aafbd9 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:39:48.173858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Attempting to bind port b982aaa4-941e-42c4-b4ad-f81777aafbd9 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:39:48.174197 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Attempting to bind port b982aaa4-941e-42c4-b4ad-f81777aafbd9 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:39:48.242078 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:39:48.242491 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:48.242851 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.243247 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:39:48.243735 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Bound port: b982aaa4-941e-42c4-b4ad-f81777aafbd9, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:39:48.244105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.349286 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Pushing event updated for resources: {'Port': ['ID=b982aaa4-941e-42c4-b4ad-f81777aafbd9,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:48.355193 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:48.468575 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.519480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:48.548084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] For port b982aaa4-941e-42c4-b4ad-f81777aafbd9, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:39:48.550183 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:48.562080 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Usage tracker for resource:port and tenant:a3af7d82fba84269a3596d85213ae5e2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:48.568845 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:48.583785 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:48.585252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.607319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] For port b982aaa4-941e-42c4-b4ad-f81777aafbd9, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=b982aaa4-941e-42c4-b4ad-f81777aafbd9,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:39:48.617986 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Usage tracker for resource:security_group_rule and tenant:e4cb3e7651204244bd1d7558651f3de2 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:48.621584 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:48.629538 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:48.631372 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.643810 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.656843 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:48.658756 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:48.660549 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.810386 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 5b4b432d-d952-49ef-93f0-73b1c2062489, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5b4b432d-d952-49ef-93f0-73b1c2062489,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:39:48.828232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.856354 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Pushing event updated for resources: {'Port': ['ID=b982aaa4-941e-42c4-b4ad-f81777aafbd9,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:48.865552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:48.870551 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.019s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:48.876645 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.884821 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.940297 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:48.945744 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2ed84921-0e9b-48a5-bb4a-c764f63c074d req-4a1c6c41-cf33-43d4-9bac-809ac50bc131 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.3273141
Jun 02 16:39:48.952129 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:49.029114 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:49.031633 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c251ca0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:49.143495 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:49.157700 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=5b4b432d-d952-49ef-93f0-73b1c2062489,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:49.172927 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:49.192441 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-db876f41-926c-42a6-bb28-a93d85b917f2 req-591d2133-5197-46df-a391-27872f9e3ecf tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1686432
Jun 02 16:39:49.214322 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Usage tracker for resource:port and tenant:a940e65f547649a6b5dbd349c6239cbc is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:49.222105 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.db.resource_extend [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:39:49.230586 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:49.244910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:49.252703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.256284 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Pushing event updated for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:49.269969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:49.270483 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:49.297903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.316734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.330503 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Made reservation on behalf of a940e65f547649a6b5dbd349c6239cbc for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:39:49.347376 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.349848 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e4cb3e7651204244bd1d7558651f3de2&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4619992
Jun 02 16:39:49.350735 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48076) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:49.354294 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1d11a73-f71a-487c-9880-0a2d1a40f223,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:49.374874 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:49.387252 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:49.410613 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0a9796d3-6357-4d27-a451-e4d38c0ab6f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:49.458577 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:49.490405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:49.493917 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:49.494896 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.576833 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5b4b432d-d952-49ef-93f0-73b1c2062489 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:49.581631 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.663772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:49.884679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.010814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.012685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48092) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:50.025273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.040935 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5b4b432d-d952-49ef-93f0-73b1c2062489 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:50.041568 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.044037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.113116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bae01f0e-4977-46e5-b1e5-8cb2d46fd5a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:50.120453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Allocated IP 172.20.0.3 (87543dfa-9cef-40b2-b537-1f95fcf2b066/409c7043-b3b6-42f7-90b5-f7db5d717e70/98e1f389-92e2-4b54-838c-4df675f8b9b3) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:50.491516 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.623025 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c251ca0>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:43Z', 'revision_number': 3, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:50.630824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203072cb-4b00-41c8-ae16-51a7a686682e None None] The sync data for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi is: [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:43Z', 'revision_number': 3, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:39:50.672631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:50.697423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48108) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:50.723694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:50.873974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:50.899524 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-34537e80-4568-40cf-9dc7-9799aff3a8a2 req-4bdef87e-a84d-4b8e-a9a9-71739e88ce59 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.2008595
Jun 02 16:39:51.006370 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:51.031630 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e779a5b4-a780-4d13-b92b-4239133c5399 req-353a42d9-57b0-461d-b703-a5b435366fd6 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.4901445
Jun 02 16:39:51.040130 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Pushing event updated for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:51.074844 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Usage tracker for resource:security_group_rule and tenant:844939a6d1d340bfb834ad3158c62515 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:51.084636 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.972s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:51.085440 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:51.100323 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:51.134578 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.150574 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:51.185354 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1d11a73-f71a-487c-9880-0a2d1a40f223,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:51.202891 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:51.220376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:51.223860 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:51.263418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.264704 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b1d11a73-f71a-487c-9880-0a2d1a40f223 HTTP/1.1" status: 204  len: 168 time: 1.8888774
Jun 02 16:39:51.279382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Pushing event updated for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:51.408600 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-5481f956-09d0-4364-9d89-a28d50cdb39e None None] Provisioning complete for port c812a3b1-038c-4274-8dfb-011532b44752 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:51.409280 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5481f956-09d0-4364-9d89-a28d50cdb39e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.501665 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 2.096s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:51.528778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.582265 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:39:51.596777 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-5481f956-09d0-4364-9d89-a28d50cdb39e None None] Port c812a3b1-038c-4274-8dfb-011532b44752 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:39:51.615888 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b982aaa4-941e-42c4-b4ad-f81777aafbd9 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:51.704052 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Allocated IP 172.20.0.10 (8d1e36c6-d295-4363-85e5-dce458b299cc/caf8e91b-8d46-4a47-a396-8ce21c092e9d/adaa7944-ce71-4265-bd85-afb28a3d7c81) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:51.725165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.747233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:51.788979 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.796080 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:51.797660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port b982aaa4-941e-42c4-b4ad-f81777aafbd9 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:39:51.801013 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Usage tracker for resource:security_group_rule and tenant:7201f9da6f8c4ad3b5d189383c019df0 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:51.805445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:51.812646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.813753 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:51.823368 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port b982aaa4-941e-42c4-b4ad-f81777aafbd9 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:51.825730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.829868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:51.847187 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Router aaae5f75-b61b-4f4d-8d83-298cf66986f0 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:39:51.906839 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=844939a6d1d340bfb834ad3158c62515&name=default HTTP/1.1" status: 200  len: 2975 time: 1.8925934
Jun 02 16:39:51.910466 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48124) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:51.927016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:51.988154 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:51.990348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:52.009692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:52.012379 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port b982aaa4-941e-42c4-b4ad-f81777aafbd9, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=b982aaa4-941e-42c4-b4ad-f81777aafbd9,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:39:52.022241 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.027792 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:52.030506 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:52.031860 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.085282 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48130) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:52.086176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b4e7ad8-4705-4cea-b538-52e5d88eb80f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:52.138139 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:52.169525 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.242292 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:52.254979 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=b982aaa4-941e-42c4-b4ad-f81777aafbd9,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:52.257038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Usage tracker for resource:security_group_rule and tenant:a43d5dbf14e24748b2abcc9f66ce9bc8 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:52.260638 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:52.266261 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:52.272864 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:52.335263 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.385528 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.407060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.473335 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.621068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8b06a700-c150-4a7a-b3de-c39da918c428 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:52.663744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3f7defe-83a4-4460-a243-0ac398fdffc9,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:52.669063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.683078 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7201f9da6f8c4ad3b5d189383c019df0&name=default HTTP/1.1" status: 200  len: 2977 time: 1.9796648
Jun 02 16:39:52.697812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.707867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48138) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:52.713224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event updated for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:52.722509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.975s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:52.727754 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:52.731480 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c07dd82d-d24b-44e8-83d1-f96a96c52b84 req-6a92fcdb-f2a6-4fc9-9967-3ebfa44c617c tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.3319082
Jun 02 16:39:52.738991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.059s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:52.842034 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a43d5dbf14e24748b2abcc9f66ce9bc8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7480123
Jun 02 16:39:52.849002 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48142) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:52.869154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:39:52.886045 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-d83e05c2-18fb-4622-bc6a-c95cd2751abf tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:52.886790 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-d83e05c2-18fb-4622-bc6a-c95cd2751abf tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:52.895698 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 5.8571186
Jun 02 16:39:52.939916 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] 10.222.0.25 "PUT /v2.0/routers/aaae5f75-b61b-4f4d-8d83-298cf66986f0/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.8239875
Jun 02 16:39:52.942837 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:52.963974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-d83e05c2-18fb-4622-bc6a-c95cd2751abf tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:52.965397 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-d83e05c2-18fb-4622-bc6a-c95cd2751abf tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 931 time: 0.7382061
Jun 02 16:39:52.976861 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.011694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=397de49b-5258-4cf1-b389-c215d161eb04,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:53.017302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-dee0ba2d-5fa8-4b52-b412-32bd14109721 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:53.028184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:53.038227 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.075818 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.097009 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.108733 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48146) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:53.111622 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.113663 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2b4e7ad8-4705-4cea-b538-52e5d88eb80f HTTP/1.1" status: 204  len: 168 time: 1.1930799
Jun 02 16:39:53.166586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b4e7ad8-4705-4cea-b538-52e5d88eb80f,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:53.221885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:53.233806 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:39:53.247293 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] 10.222.0.25 "PUT /v2.0/routers/0f4b3491-20d5-45fe-85b1-eae089a74e29/add_router_interface HTTP/1.1" status: 200  len: 503 time: 9.8031936
Jun 02 16:39:53.258822 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:39:53.293460 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:53.295515 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c01fee0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:53.314478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.321233 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.323705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:53.334255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-780ca374-e457-4126-bb0a-81e212669c20 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:53.363573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=397de49b-5258-4cf1-b389-c215d161eb04,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:53.427361 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.440262 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-780ca374-e457-4126-bb0a-81e212669c20 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:53.442228 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d68e3056-ef01-479d-9ce9-ca6ab39610d3 req-780ca374-e457-4126-bb0a-81e212669c20 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4597085
Jun 02 16:39:53.472915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3f7defe-83a4-4460-a243-0ac398fdffc9,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:53.490634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:53.496731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.136s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:53.497415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:53.500053 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.510046 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b3f7defe-83a4-4460-a243-0ac398fdffc9 HTTP/1.1" status: 204  len: 168 time: 0.6515362
Jun 02 16:39:53.517176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.520302 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-53aac080-3c03-41e8-8ba3-e7192ca9de41 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/397de49b-5258-4cf1-b389-c215d161eb04 HTTP/1.1" status: 204  len: 168 time: 0.7916775
Jun 02 16:39:53.537659 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.564029 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:53.635771 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b982aaa4-941e-42c4-b4ad-f81777aafbd9 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:39:53.669648 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Sync routers for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:39:53.730424 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Network 8d1e36c6-d295-4363-85e5-dce458b299cc is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:39:53.734470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:39:53.739440 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:39:53.745918 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:53.746560 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.778892 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Pushing event updated for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:53.783184 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 5.8084371
Jun 02 16:39:53.784524 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:53.786949 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:53.788078 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c22adc0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:53.872609 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:53.881439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:53.927469 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:53.936868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Usage tracker for resource:security_group_rule and tenant:129ac2c0e449493f84747c7ff8e78d4c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:53.947046 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:53.960659 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:54.050675 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port b982aaa4-941e-42c4-b4ad-f81777aafbd9 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:39:54.051452 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.066510 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48170) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:54.120678 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.203177 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:54.228125 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Usage tracker for resource:security_group_rule and tenant:368b54fbdf4147b0bd364dec607eeab4 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:54.241488 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:54.298540 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:54.307369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e71784-d7f8-4d45-9cb9-496a0da25f98 req-2b0700f3-c501-4c8a-89f9-3c5f7926f1ec tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:54.308162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0e71784-d7f8-4d45-9cb9-496a0da25f98 req-2b0700f3-c501-4c8a-89f9-3c5f7926f1ec tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Synchronizing usage tracker for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:54.399145 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.419925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.438618 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0e71784-d7f8-4d45-9cb9-496a0da25f98 req-2b0700f3-c501-4c8a-89f9-3c5f7926f1ec tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Unset dirty status for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:54.440658 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0e71784-d7f8-4d45-9cb9-496a0da25f98 req-2b0700f3-c501-4c8a-89f9-3c5f7926f1ec tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 932 time: 0.4258738
Jun 02 16:39:54.458001 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d15a8704-2c3c-45f8-a54a-164e0413413e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:54.540933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:54.581276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0e71784-d7f8-4d45-9cb9-496a0da25f98 req-b5eaebfa-d676-468a-9ec4-cc469633ecbd tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1300039
Jun 02 16:39:54.615579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48178) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:54.616287 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=129ac2c0e449493f84747c7ff8e78d4c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4988344
Jun 02 16:39:54.632798 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04801674-d5b1-4b61-998d-a262d6247be8,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:54.636963 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:54.757055 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.767381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:54.784599 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:54.880411 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=368b54fbdf4147b0bd364dec607eeab4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8128347
Jun 02 16:39:54.887316 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48184) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:54.888739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc2c74aa-76ed-4ae6-bc7b-eda6a8af540e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:54.927357 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:55.032702 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c01fee0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:39:47Z', 'revision_number': 2, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:55.044050 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:39:55.044411 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Updating router 0f4b3491-20d5-45fe-85b1-eae089a74e29 port c812a3b1-038c-4274-8dfb-011532b44752 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:39:55.100444 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.101954 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.173941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.174777 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.196317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.295920 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.302014 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-602780ff-9602-4f93-9c94-c183fd36734d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:55.338021 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04801674-d5b1-4b61-998d-a262d6247be8,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:55.341223 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:55.345398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.347683 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/04801674-d5b1-4b61-998d-a262d6247be8 HTTP/1.1" status: 204  len: 168 time: 0.7310281
Jun 02 16:39:55.360350 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.364960 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:55.386645 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc2c74aa-76ed-4ae6-bc7b-eda6a8af540e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:55.392628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:55.416176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.417453 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cc2c74aa-76ed-4ae6-bc7b-eda6a8af540e HTTP/1.1" status: 204  len: 168 time: 0.5255611
Jun 02 16:39:55.424036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-84df95d3-571c-4562-9438-007223a7292a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:39:55.425490 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-84df95d3-571c-4562-9438-007223a7292a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0070634
Jun 02 16:39:55.430944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-a1a67767-b229-463e-9e51-0fd1e589dfb1 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:39:55.433050 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-a1a67767-b229-463e-9e51-0fd1e589dfb1 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0134630
Jun 02 16:39:55.722867 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c22adc0>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:49Z', 'revision_number': 4, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '5e024a6b-65b5-4078-af70-6779bd688836', 'name': '', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'mac_address': 'fa:16:3e:95:f8:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:47Z', 'updated_at': '2021-06-02T16:39:49Z', 'revision_number': 2, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'subnets': [{'id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:55.736239 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Checking router: aaae5f75-b61b-4f4d-8d83-298cf66986f0 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:39:55.738743 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Updating router aaae5f75-b61b-4f4d-8d83-298cf66986f0 port 5e024a6b-65b5-4078-af70-6779bd688836 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:39:55.857640 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3810f86b-adef-455b-8517-ddc0e5877b8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.875395 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:55.995228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48218) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:55.997015 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-691ac3e6-2fce-401b-84dd-bf7d379293c1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:56.000874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-691ac3e6-2fce-401b-84dd-bf7d379293c1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:network {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:56.001709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group': {'name': 'tempest-securitygroup--549707327', 'description': 'tempest-description--1782542052'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:56.014524 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:56.024974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:56.037269 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:56.043938 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:56.055850 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.098035 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.101504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-691ac3e6-2fce-401b-84dd-bf7d379293c1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:network {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:56.111554 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-691ac3e6-2fce-401b-84dd-bf7d379293c1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 818 time: 0.5493343
Jun 02 16:39:56.118641 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Transition to ACTIVE for port object c812a3b1-038c-4274-8dfb-011532b44752 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:56.143549 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:56.147937 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.151329 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-29e318e7-b5a7-4663-bb00-56270c7bdd6e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/quotas/2a331932fba240f7a0fbb0b93203268c HTTP/1.1" status: 200  len: 375 time: 0.0361552
Jun 02 16:39:56.162211 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:56.172130 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a89726be-ed9b-494f-9122-4a06079dafad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:56.175857 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:56.186002 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:56.412513 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-aaa08b58-b927-421b-a4e4-a90aa7e83a3c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&fields=id HTTP/1.1" status: 200  len: 255 time: 0.2579341
Jun 02 16:39:56.530217 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.590829 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.618756 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:56.638857 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Pushing event updated for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:56.656922 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.485s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:56.734166 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:56.739551 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:56.770328 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d04384-8bc3-42eb-9095-ff50e474581d req-d8812716-76c0-48b3-9143-4f6f22891d34 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:56.772344 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-75d04384-8bc3-42eb-9095-ff50e474581d req-d8812716-76c0-48b3-9143-4f6f22891d34 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 931 time: 0.4236200
Jun 02 16:39:56.773787 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.777804 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.7780271
Jun 02 16:39:56.777949 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48232) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:56.784082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group_rule': {'security_group_id': '9e9b4c9b-9c70-47be-ab19-875e72ba0d3e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:56.803601 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:56.812673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:56.818189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:56.840313 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Attempting to bind port c812a3b1-038c-4274-8dfb-011532b44752 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:39:56.840708 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Attempting to bind port c812a3b1-038c-4274-8dfb-011532b44752 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:39:56.841070 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Attempting to bind port c812a3b1-038c-4274-8dfb-011532b44752 on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:39:56.844036 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:56.852715 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:39:56.853097 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Checking segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:56.853504 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.854266 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Bound using segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:39:56.854742 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Bound port: c812a3b1-038c-4274-8dfb-011532b44752, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:39:56.855108 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.861630 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-75d04384-8bc3-42eb-9095-ff50e474581d req-4f645729-f766-4666-8bb2-beeca46da03a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0795093
Jun 02 16:39:56.889803 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:56.927567 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Request body: {'port': {'device_id': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:57.013497 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ec60ff68-d455-4489-a524-8e42bb7a4d21 service neutron] 10.222.0.25 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5963237
Jun 02 16:39:57.062064 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.112030 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Transition to ACTIVE for port object 5e024a6b-65b5-4078-af70-6779bd688836 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:39:57.117922 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.125239 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.127744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.128409 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:57.147795 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4dadabf6-e733-4894-a1de-c6c6f03516e5,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:57.148430 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:57.158279 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Request body: {'port': {'device_id': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:57.198855 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] For port c812a3b1-038c-4274-8dfb-011532b44752, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:39:57.206806 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:57.208642 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] For port c812a3b1-038c-4274-8dfb-011532b44752, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c812a3b1-038c-4274-8dfb-011532b44752,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:39:57.215979 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.239054 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-0055bbb1-319e-4330-8988-d0ab37e7e4c0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:57.244719 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.247211 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4681427
Jun 02 16:39:57.251184 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48242) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:57.258329 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group_rule': {'security_group_id': '9e9b4c9b-9c70-47be-ab19-875e72ba0d3e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:57.272127 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:57.294300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:57.299473 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:57.326146 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2d4859-c7ea-4e81-9421-7d6ca8e3e5e0 req-0b8027cd-2eaf-4244-a586-88a6e776c9b4 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:57.334003 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5a2d4859-c7ea-4e81-9421-7d6ca8e3e5e0 req-0b8027cd-2eaf-4244-a586-88a6e776c9b4 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 932 time: 0.1871450
Jun 02 16:39:57.367596 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Pushing event updated for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:57.371758 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:57.374277 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:57.399096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5a2d4859-c7ea-4e81-9421-7d6ca8e3e5e0 req-1ed903f2-2ffb-44ab-8035-c7def9904161 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Synchronizing usage tracker for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:39:57.433261 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:57.434072 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c01fee0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:57.439680 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.526285 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5a2d4859-c7ea-4e81-9421-7d6ca8e3e5e0 req-1ed903f2-2ffb-44ab-8035-c7def9904161 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Unset dirty status for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:39:57.542594 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5a2d4859-c7ea-4e81-9421-7d6ca8e3e5e0 req-1ed903f2-2ffb-44ab-8035-c7def9904161 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2073019
Jun 02 16:39:57.661393 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.668735 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.670810 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:57.743335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.747311 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4946413
Jun 02 16:39:57.750453 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48256) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:39:57.767303 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:39:57.772035 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e6a1818-ea11-48db-9ea2-871788172c7c,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:57.786235 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Pushing event updated for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:57.791910 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:57.796068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:39:57.809972 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:floatingip and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:39:57.815002 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:39:57.829814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:39:57.832363 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.593s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:57.852954 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:57.856581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.039428 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Attempting to bind port 5e024a6b-65b5-4078-af70-6779bd688836 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:39:58.039851 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Attempting to bind port 5e024a6b-65b5-4078-af70-6779bd688836 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:39:58.040177 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Attempting to bind port 5e024a6b-65b5-4078-af70-6779bd688836 on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:39:58.054223 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:39:58.054618 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Checking segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:39:58.055020 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.055415 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Bound using segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:39:58.056021 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Bound port: 5e024a6b-65b5-4078-af70-6779bd688836, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:39:58.056558 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.194535 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:58.250109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.348166 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] For port 5e024a6b-65b5-4078-af70-6779bd688836, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:39:58.364295 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] For port 5e024a6b-65b5-4078-af70-6779bd688836, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5e024a6b-65b5-4078-af70-6779bd688836,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:39:58.373930 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.381347 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:39:58.404592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e4fbad-b90a-443f-8b81-06417beb9d04 req-f1afcec4-b57b-46a4-9e07-5aa0494e3acb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:58.411816 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6e4fbad-b90a-443f-8b81-06417beb9d04 req-f1afcec4-b57b-46a4-9e07-5aa0494e3acb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 931 time: 0.1790011
Jun 02 16:39:58.510343 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-142511f7-c532-4a28-87bf-7c53379eb766 service neutron] 10.222.0.25 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.4809628
Jun 02 16:39:58.535980 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6e4fbad-b90a-443f-8b81-06417beb9d04 req-42c138d0-0686-4f59-802b-4b3cfbb8c19f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1231053
Jun 02 16:39:58.544878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:58.680673 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:39:58.684761 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c22adc0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:39:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:59.218094 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9b8df809-01a5-4202-874d-de5be8000bdd req-30aa8a0a-68de-4b2d-93dd-e2db5370c35a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 210 time: 0.2205689
Jun 02 16:39:59.247500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Allocated IP 172.27.0.132 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/a2a91175-b8bf-4101-ab5f-3143eb52f9d7) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:39:59.304449 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 98e1f389-92e2-4b54-838c-4df675f8b9b3 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:39:59.316384 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96075549-236e-41ca-844e-384f085efafa req-e35865cd-a93c-4f48-b27a-96eed2263199 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:39:59.318337 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-96075549-236e-41ca-844e-384f085efafa req-e35865cd-a93c-4f48-b27a-96eed2263199 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 932 time: 0.3486168
Jun 02 16:39:59.330537 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c01fee0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:39:57Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:39:59.343524 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d36c33ea-fc5b-40ae-97e4-645d67f61e17 None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:39:57Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:39:59.356814 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:59.458788 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-eb9f0576-d47b-463e-923f-f31429a18f3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:59.500667 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-96075549-236e-41ca-844e-384f085efafa req-ef0bceb5-61ae-4f62-94ca-7950cabff240 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1741076
Jun 02 16:39:59.553103 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Pushing event updated for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:39:59.568973 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.188s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:39:59.571088 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:59.643657 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:39:59.806923 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:59.902334 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:39:59.932757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:00.058928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:40:00.076381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:00.112967 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:40:00.294685 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:00.396979 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:00.584550 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Transition to ACTIVE for port object 98e1f389-92e2-4b54-838c-4df675f8b9b3 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:00.597807 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c22adc0>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:49Z', 'revision_number': 4, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '5e024a6b-65b5-4078-af70-6779bd688836', 'name': '', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'mac_address': 'fa:16:3e:95:f8:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:47Z', 'updated_at': '2021-06-02T16:39:58Z', 'revision_number': 4, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'subnets': [{'id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:00.601865 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-143e94d4-1b81-4315-93c2-0f21fb06ed1b None None] The sync data for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi is: [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:39:49Z', 'revision_number': 4, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '5e024a6b-65b5-4078-af70-6779bd688836', 'name': '', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'mac_address': 'fa:16:3e:95:f8:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:47Z', 'updated_at': '2021-06-02T16:39:58Z', 'revision_number': 4, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'subnets': [{'id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:40:00.616651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id adaa7944-ce71-4265-bd85-afb28a3d7c81 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:00.626816 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:00.645060 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Transition to ACTIVE for port object adaa7944-ce71-4265-bd85-afb28a3d7c81 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:00.646234 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:00.659627 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-44892298-80ad-4123-a0de-a614cb14bce8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:00.705526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:00.837165 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-34cfe93a-0277-4529-815b-59a4b5e70882 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:00.844121 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-34cfe93a-0277-4529-815b-59a4b5e70882 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 818 time: 0.6674840
Jun 02 16:40:00.875063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=a2a91175-b8bf-4101-ab5f-3143eb52f9d7,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:00.885721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.953s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:00.915853 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-21365a56-4063-4225-96c8-09c955e917dc tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/quotas/2a331932fba240f7a0fbb0b93203268c HTTP/1.1" status: 200  len: 375 time: 0.0707543
Jun 02 16:40:01.003235 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.110454 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-aa954f1d-b262-495a-97bd-cd5e8e287f9f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:01.121494 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Pushing event updated for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:01.133420 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:01.141962 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-aa954f1d-b262-495a-97bd-cd5e8e287f9f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:01.143550 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-aa954f1d-b262-495a-97bd-cd5e8e287f9f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&fields=id HTTP/1.1" status: 200  len: 255 time: 0.2269154
Jun 02 16:40:01.209235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9663863d-9df1-42b0-a028-57506c4f7c80 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.438s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:01.246647 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7044c45-f801-445f-a14e-7683f4521269 req-8a26c3e2-d662-4862-9b1f-2442e5cde48c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:01.248239 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a7044c45-f801-445f-a14e-7683f4521269 req-8a26c3e2-d662-4862-9b1f-2442e5cde48c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 931 time: 0.9466596
Jun 02 16:40:01.352657 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Attempting to bind port 98e1f389-92e2-4b54-838c-4df675f8b9b3 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:01.353198 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Attempting to bind port 98e1f389-92e2-4b54-838c-4df675f8b9b3 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:01.353555 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Attempting to bind port 98e1f389-92e2-4b54-838c-4df675f8b9b3 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:01.390568 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.401009 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.404735 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Attempting to bind port adaa7944-ce71-4265-bd85-afb28a3d7c81 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:01.404945 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Attempting to bind port adaa7944-ce71-4265-bd85-afb28a3d7c81 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'a06ec11a-1aa9-49e2-824a-cb70c50736bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:01.405231 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Attempting to bind port adaa7944-ce71-4265-bd85-afb28a3d7c81 on network 8d1e36c6-d295-4363-85e5-dce458b299cc {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:01.411564 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Port 98e1f389-92e2-4b54-838c-4df675f8b9b3 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:01.411889 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Attempting to bind port 98e1f389-92e2-4b54-838c-4df675f8b9b3 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:01.422195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:01.422542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Checking segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:01.423489 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Bound using segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:01.424099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Bound port: 98e1f389-92e2-4b54-838c-4df675f8b9b3, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:01.424595 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.464434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2f259231-3c67-4f00-9f82-138ca85ceed6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:01.475568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Port adaa7944-ce71-4265-bd85-afb28a3d7c81 on network 8d1e36c6-d295-4363-85e5-dce458b299cc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:01.481461 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Attempting to bind port adaa7944-ce71-4265-bd85-afb28a3d7c81 on network 8d1e36c6-d295-4363-85e5-dce458b299cc {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:01.510643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:01.512731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Checking segment: {'id': 'a06ec11a-1aa9-49e2-824a-cb70c50736bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:01.516281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Bound using segment: {'id': 'a06ec11a-1aa9-49e2-824a-cb70c50736bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:01.538085 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Bound port: adaa7944-ce71-4265-bd85-afb28a3d7c81, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a06ec11a-1aa9-49e2-824a-cb70c50736bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:01.538506 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.558552 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.20', 50731) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:01.587891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Pushing event updated for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:01.641814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.647815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.439s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:01.683619 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.685462 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a7044c45-f801-445f-a14e-7683f4521269 req-3fe37b69-303e-4676-bff1-3bcd35262dfa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4199405
Jun 02 16:40:01.698614 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.9462264
Jun 02 16:40:01.839816 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:01.859224 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=a2a91175-b8bf-4101-ab5f-3143eb52f9d7,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:01.919439 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5e024a6b-65b5-4078-af70-6779bd688836 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:01.920643 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.456s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:01.951152 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:01.961977 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81,segment=NetworkSegment(a06ec11a-1aa9-49e2-824a-cb70c50736bf),segment_id=a06ec11a-1aa9-49e2-824a-cb70c50736bf)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:01.996215 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 5e024a6b-65b5-4078-af70-6779bd688836 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:02.000364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-7cfacadc-909f-4eca-b6b0-1e8bdf96a4ac tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:02.002932 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-7cfacadc-909f-4eca-b6b0-1e8bdf96a4ac tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 818 time: 0.4383724
Jun 02 16:40:02.004337 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5e024a6b-65b5-4078-af70-6779bd688836 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:02.004718 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.007127 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-201599c8-7167-4f42-ac0c-a4e19f649a1d service neutron] 10.222.0.25 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8295410
Jun 02 16:40:02.026416 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.049690 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Request body: {'port': {'device_id': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'admin_state_up': True, 'tenant_id': '2a331932fba240f7a0fbb0b93203268c'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:02.068040 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:02.150716 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:02.151333 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.152774 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] 10.222.0.20 "PUT /v2.0/ports/adaa7944-ce71-4265-bd85-afb28a3d7c81 HTTP/1.1" status: 200  len: 1094 time: 5.8404143
Jun 02 16:40:02.168174 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:02.279116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:02.285249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.327673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:02.338589 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 5e024a6b-65b5-4078-af70-6779bd688836, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5e024a6b-65b5-4078-af70-6779bd688836,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:02.344547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Pushing event updated for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:02.346215 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.348352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:02.351087 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.360432 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c812a3b1-038c-4274-8dfb-011532b44752 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:02.370349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a5735995-9cca-46a0-a6f8-d544caf57b43 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:02.406210 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-a03351a6-26b3-42a9-945c-8b4cdfe7a13e service neutron] 10.222.0.25 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3926623
Jun 02 16:40:02.413581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:02.424718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:02.436800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Made reservation on behalf of 2a331932fba240f7a0fbb0b93203268c for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:02.441635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.441836 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:02.493897 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2c0e09-2529-4fae-86b6-dc0c9be2a63f req-f1dd8986-aab5-472b-8f33-484a5f62b04b tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:02.495873 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b2c0e09-2529-4fae-86b6-dc0c9be2a63f req-f1dd8986-aab5-472b-8f33-484a5f62b04b tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.5304935
Jun 02 16:40:02.528881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:02.533562 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.535463 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] 10.222.0.20 "PUT /v2.0/ports/98e1f389-92e2-4b54-838c-4df675f8b9b3 HTTP/1.1" status: 200  len: 1093 time: 6.2273536
Jun 02 16:40:02.725945 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-a720f52f-9c55-4bfa-9100-4df0a8afa4a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:02.727387 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-a720f52f-9c55-4bfa-9100-4df0a8afa4a1 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a940e65f547649a6b5dbd349c6239cbc&device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 1097 time: 0.4878867
Jun 02 16:40:02.780766 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Pushing event updated for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:02.823223 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:02.827697 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:02.841974 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port c812a3b1-038c-4274-8dfb-011532b44752 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:02.850676 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port c812a3b1-038c-4274-8dfb-011532b44752 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:02.851343 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:02.860044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Allocated IP 172.20.0.2 (1f2f7c0d-7d36-4292-bab6-39e7de3c95ef/0181ac68-65a5-4b9a-9995-215bf77b5c32/b28c3bf7-7098-48bc-8c31-211ba369c5bf) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:40:02.965500 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-2fe499ae-d84f-454d-bcdd-4182aa948138 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81 HTTP/1.1" status: 200  len: 217 time: 0.1897774
Jun 02 16:40:02.968741 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f59f625-a793-4efc-af88-343b9a90ae3f" -d '{"events": [{"name": "network-changed", "server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:02.974001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.604s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:03.072105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:03.083416 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-d90e5fcf-c8ce-422b-b66a-9755afe993d5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:03.155326 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b2c0e09-2529-4fae-86b6-dc0c9be2a63f req-385a0d68-577c-40ba-813d-1d2b298260a2 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6087408
Jun 02 16:40:03.173072 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port c812a3b1-038c-4274-8dfb-011532b44752, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c812a3b1-038c-4274-8dfb-011532b44752,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:03.181656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:03.192351 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:03.222658 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-bc7838aa-3b35-4068-9f2b-72ecfb51fa46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:03.224441 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-bc7838aa-3b35-4068-9f2b-72ecfb51fa46 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=caf8e91b-8d46-4a47-a396-8ce21c092e9d HTTP/1.1" status: 200  len: 852 time: 0.2391002
Jun 02 16:40:03.333264 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-a4f52241-f11e-4262-a70e-c4e96ea6f46d service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8d1e36c6-d295-4363-85e5-dce458b299cc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0972679
Jun 02 16:40:03.395378 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:03.405886 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:03.430586 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-751ea09d-8028-4bf5-ac7c-5fb0ebd1db4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:03.432481 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-751ea09d-8028-4bf5-ac7c-5fb0ebd1db4a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 1096 time: 0.8138354
Jun 02 16:40:03.443590 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-d90e5fcf-c8ce-422b-b66a-9755afe993d5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:03.454269 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-d90e5fcf-c8ce-422b-b66a-9755afe993d5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--549707327&fields=id&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 267 time: 0.5570920
Jun 02 16:40:03.485198 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf31cbe0-6f64-4b79-8817-67f3f961bf26 req-c1c2029f-91b2-4e03-a929-49d9f092a2a4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 210 time: 0.2501893
Jun 02 16:40:03.587532 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5e024a6b-65b5-4078-af70-6779bd688836 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:03.689194 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-c776cda4-6cd1-4415-ad59-52372e99a391 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:03.698432 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-c776cda4-6cd1-4415-ad59-52372e99a391 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 817 time: 0.2428360
Jun 02 16:40:03.787504 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-796eee3a-c729-4609-8ed1-33c51719e27b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/quotas/545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 375 time: 0.0875719
Jun 02 16:40:03.834732 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:03.861671 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5e024a6b-65b5-4078-af70-6779bd688836 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:03.863012 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:04.045919 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c812a3b1-038c-4274-8dfb-011532b44752 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:04.064224 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:04.094249 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-7f325eef-7beb-42e0-a005-fe643b1ae7c5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3052368
Jun 02 16:40:04.184338 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-63df4ea2-63b7-4236-ae98-576879185421 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3 HTTP/1.1" status: 200  len: 217 time: 0.7106202
Jun 02 16:40:04.198233 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port c812a3b1-038c-4274-8dfb-011532b44752 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:04.199812 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:04.327948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:04.346287 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-b4384f76-f026-4e57-b1e9-0847a14ac396 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:04.348490 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-b4384f76-f026-4e57-b1e9-0847a14ac396 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1191270
Jun 02 16:40:04.353074 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:04.427540 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-88447103-3a9b-49f2-82f2-11a4cd71ab7a service neutron] 10.222.0.20 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.0162089
Jun 02 16:40:04.431027 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-10146452-a181-40e7-b40f-cce45064b4c6 service neutron] 10.222.0.25 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3325517
Jun 02 16:40:04.448776 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-6bcbc9da-1e41-42d7-ae8a-ca695e6c8c15 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0754595
Jun 02 16:40:04.533286 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:40:04.632998 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:04.646716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:40:04.653200 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:04.653511 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:04.697666 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8a835f43-012b-46ce-ac79-b1b4e1c4cf72 service neutron] 10.222.0.25 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2554052
Jun 02 16:40:04.698273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Pushing event updated for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:04.710767 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:04.729900 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.7190063
Jun 02 16:40:04.744343 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Request body: {'port': {'device_id': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:04.761661 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.20', 50736) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:04.837935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3c537b-8b90-4082-ae37-52849f416f13 req-3b0ea358-f219-4985-8a02-1382fe78c93e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:04.849386 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6e3c537b-8b90-4082-ae37-52849f416f13 req-3b0ea358-f219-4985-8a02-1382fe78c93e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 943 time: 0.6637948
Jun 02 16:40:04.949287 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-c4b079f6-e630-471e-aa23-6496560f3e95 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4629302
Jun 02 16:40:05.077666 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f7106e5-dd7a-4cca-b5da-5ec6005bf62c req-9fbc5122-c8d4-4723-a75c-5a8ffae0cb60 service neutron] 10.222.0.20 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6309335
Jun 02 16:40:05.137869 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6e3c537b-8b90-4082-ae37-52849f416f13 req-0457c1d0-7162-49ec-b384-fc4d1f3df5ae tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2861092
Jun 02 16:40:05.189748 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:05.519510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ebf83e5-6047-47a8-bce6-9e8086421f4e x-openstack-request-id: req-1ebf83e5-6047-47a8-bce6-9e8086421f4e {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:05.520516 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:05.521967 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1ebf83e5-6047-47a8-bce6-9e8086421f4e {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:05.522638 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81', 'status': 'completed', 'code': 200}
Jun 02 16:40:05.683292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-51382d2d-5940-44a7-9fd4-33cb8649936d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:05.685463 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-51382d2d-5940-44a7-9fd4-33cb8649936d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 818 time: 0.9226801
Jun 02 16:40:05.691688 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f73949b-5a99-4dff-85ae-dc70dfd4f91f req-439922cb-05c5-4abc-b084-7e6545442e07 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7252870
Jun 02 16:40:05.702163 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Request body: {'port': {'device_id': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'admin_state_up': True, 'tenant_id': '2a331932fba240f7a0fbb0b93203268c'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:05.879721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ff92b9bc-b25c-4068-8c14-c37470d07a99 req-89d3ea6e-1c1d-42bd-a60f-0f9a59b412b7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:05.928581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ff92b9bc-b25c-4068-8c14-c37470d07a99 req-89d3ea6e-1c1d-42bd-a60f-0f9a59b412b7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:05.933173 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:05.938287 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ff92b9bc-b25c-4068-8c14-c37470d07a99 req-89d3ea6e-1c1d-42bd-a60f-0f9a59b412b7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 210 time: 0.2925260
Jun 02 16:40:05.972869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db2e66f7-175f-4792-8d5b-4c43e346f307 req-260eb229-0183-46cb-8459-ac5079ef27da tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:05.976165 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-db2e66f7-175f-4792-8d5b-4c43e346f307 req-260eb229-0183-46cb-8459-ac5079ef27da tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.4246800
Jun 02 16:40:05.985353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-62143c78-cbca-4089-800b-1ccfe38f096c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:05.986886 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-62143c78-cbca-4089-800b-1ccfe38f096c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a940e65f547649a6b5dbd349c6239cbc&device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 1097 time: 0.4414208
Jun 02 16:40:05.988999 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:06.061226 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-db2e66f7-175f-4792-8d5b-4c43e346f307 req-453d68dc-e5ed-435f-b6cf-98dd9417cd7f tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733535
Jun 02 16:40:06.061972 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Made reservation on behalf of 2a331932fba240f7a0fbb0b93203268c for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:06.065672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.141685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b28c3bf7-7098-48bc-8c31-211ba369c5bf {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:06.162885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.259249 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c3431910-6d6f-412a-a4ee-59d894a062f0 req-60b0a7ba-7963-4b2f-b1d7-876ba0df213c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 210 time: 0.0847065
Jun 02 16:40:06.270041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Transition to ACTIVE for port object b28c3bf7-7098-48bc-8c31-211ba369c5bf will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:06.283401 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.295570 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:06.397731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-41aec38f-a951-4087-912c-c9ddf86083e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:06.399216 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-41aec38f-a951-4087-912c-c9ddf86083e2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8d1e36c6-d295-4363-85e5-dce458b299cc HTTP/1.1" status: 200  len: 913 time: 0.3773146
Jun 02 16:40:06.447110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Allocated IP 172.20.0.11 (1f2f7c0d-7d36-4292-bab6-39e7de3c95ef/0181ac68-65a5-4b9a-9995-215bf77b5c32/5e1e9de7-d161-410e-9e7e-a9f74a701739) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:40:06.482941 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Attempting to bind port b28c3bf7-7098-48bc-8c31-211ba369c5bf on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:06.483271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Attempting to bind port b28c3bf7-7098-48bc-8c31-211ba369c5bf by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:06.483596 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Attempting to bind port b28c3bf7-7098-48bc-8c31-211ba369c5bf on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:06.489852 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Pushing event updated for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:06.493746 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:06.495872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Port b28c3bf7-7098-48bc-8c31-211ba369c5bf on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:06.495872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Attempting to bind port b28c3bf7-7098-48bc-8c31-211ba369c5bf on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:06.500996 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:06.501155 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Checking segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:06.501729 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Bound using segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:06.502194 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Bound port: b28c3bf7-7098-48bc-8c31-211ba369c5bf, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:06.502566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.682658 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:06.691861 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:06.702865 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.705441 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7e9a6c-cd9f-4609-960b-53c2fe9c629a req-a9c25d99-d3d6-458a-977f-8504be92c973 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:06.706994 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f7e9a6c-cd9f-4609-960b-53c2fe9c629a req-a9c25d99-d3d6-458a-977f-8504be92c973 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 943 time: 0.3649504
Jun 02 16:40:06.709576 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:06.775271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:06.777388 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.779589 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] 10.222.0.20 "PUT /v2.0/ports/b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 1093 time: 2.0411308
Jun 02 16:40:06.780368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:06.826750 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f7e9a6c-cd9f-4609-960b-53c2fe9c629a req-7ab567c1-008d-462d-9c9b-b6e5928b1def tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1086683
Jun 02 16:40:06.878475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Pushing event updated for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:06.887275 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:06.909348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f" -d '{"events": [{"name": "network-changed", "server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:06.918574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.967513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:06.995202 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:07.033725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed0885d7-8952-40cc-a68f-279e7f31c433 x-openstack-request-id: req-ed0885d7-8952-40cc-a68f-279e7f31c433 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:07.034024 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:07.034288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ed0885d7-8952-40cc-a68f-279e7f31c433 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:07.034750 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf', 'status': 'completed', 'code': 200}
Jun 02 16:40:07.181437 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:40:07.196471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:07.199511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:40:07.205819 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:07.206662 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:07.260803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Pushing event updated for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:07.265145 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:07.269337 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.5719783
Jun 02 16:40:07.294847 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-c9e650ab-3342-4abf-99e8-7aaf89487d5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:07.295631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-c9e650ab-3342-4abf-99e8-7aaf89487d5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:07.314714 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-c9e650ab-3342-4abf-99e8-7aaf89487d5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:07.316257 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-c9e650ab-3342-4abf-99e8-7aaf89487d5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 932 time: 0.1979301
Jun 02 16:40:07.355085 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf841d7d-b85b-4ddd-91d9-5f2c1c25b845 req-27b8c22e-6ac7-4b58-b405-318eb1104d68 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:07.356944 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cf841d7d-b85b-4ddd-91d9-5f2c1c25b845 req-27b8c22e-6ac7-4b58-b405-318eb1104d68 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.1097934
Jun 02 16:40:07.369343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-e72acf4b-3ce7-4e9f-8bf3-113d132da02e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:07.393925 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-e72acf4b-3ce7-4e9f-8bf3-113d132da02e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:07.396853 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e48350bc-6fb4-450e-8659-14d5f82a2161 req-e72acf4b-3ce7-4e9f-8bf3-113d132da02e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0738823
Jun 02 16:40:07.431003 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cf841d7d-b85b-4ddd-91d9-5f2c1c25b845 req-39bfb0c3-36de-4274-aa19-da51450fc99d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0672898
Jun 02 16:40:07.543390 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:07.545731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-edf7f27c-cea6-4c03-8c85-440df073b2d9" -d '{"events": [{"name": "network-changed", "server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:07.548990 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-87daaf3e-bbbb-4cd6-a33a-6256172a64a2 req-d5f56544-c9c5-4144-b924-f14c37988a12 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:07.572082 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-87daaf3e-bbbb-4cd6-a33a-6256172a64a2 req-d5f56544-c9c5-4144-b924-f14c37988a12 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:07.583691 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87daaf3e-bbbb-4cd6-a33a-6256172a64a2 req-d5f56544-c9c5-4144-b924-f14c37988a12 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 210 time: 0.0834038
Jun 02 16:40:07.608817 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4943834-22ba-46cf-821f-1cacae8a7c2b x-openstack-request-id: req-f4943834-22ba-46cf-821f-1cacae8a7c2b {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:07.609122 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:07.609384 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f4943834-22ba-46cf-821f-1cacae8a7c2b {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:07.609858 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3', 'status': 'completed', 'code': 200}
Jun 02 16:40:08.025944 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ba9a4c-b61f-4cee-8d7f-4163dafda3cb req-22b306bc-ae0c-48b8-a5da-6275aab25ca8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:08.027545 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e8ba9a4c-b61f-4cee-8d7f-4163dafda3cb req-22b306bc-ae0c-48b8-a5da-6275aab25ca8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 943 time: 0.0799553
Jun 02 16:40:08.074038 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e8ba9a4c-b61f-4cee-8d7f-4163dafda3cb req-3be6a0a7-1d9b-4828-abdd-6b56dfe2f194 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401287
Jun 02 16:40:08.165375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48632) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:08.285944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.303220 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:08.307109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Usage tracker for resource:security_group_rule and tenant:cff06ecca19c48708626228042383c11 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:08.310924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:08.316767 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:08.397328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.403903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.415346 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:08.457879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5846520-4aee-4a94-b527-84c81af229e5,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:08.461827 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=cff06ecca19c48708626228042383c11&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2953353
Jun 02 16:40:08.464468 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48642) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:08.488029 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:08.534258 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:40:08.565775 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.605791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.621730 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af32fd8e-76f5-48e3-bc08-6137b23bd4ce req-e8b2d7d1-f9a9-4d0a-9102-0807eaf4e5a3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:08.623201 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-af32fd8e-76f5-48e3-bc08-6137b23bd4ce req-e8b2d7d1-f9a9-4d0a-9102-0807eaf4e5a3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.0895014
Jun 02 16:40:08.660638 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f465b0-e2b2-4af6-be4c-12261974ff34 req-b2791e92-c844-4d74-987d-ad90876c9c65 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:08.662055 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23f465b0-e2b2-4af6-be4c-12261974ff34 req-b2791e92-c844-4d74-987d-ad90876c9c65 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 932 time: 0.1513884
Jun 02 16:40:08.671886 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-af32fd8e-76f5-48e3-bc08-6137b23bd4ce req-00d446cc-5b3c-4a0a-9627-295a6009ffb6 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426745
Jun 02 16:40:08.704132 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.712392 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0d25bd7a-a590-4bb0-82ac-2f23acb61bfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:08.722764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5846520-4aee-4a94-b527-84c81af229e5,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:08.726952 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23f465b0-e2b2-4af6-be4c-12261974ff34 req-8f51f280-1745-4c5a-bb8f-333d3e00816b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581017
Jun 02 16:40:08.727718 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:08.734755 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:08.736463 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b5846520-4aee-4a94-b527-84c81af229e5 HTTP/1.1" status: 204  len: 168 time: 0.2710752
Jun 02 16:40:08.836000 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-81273ff4-515d-4964-b5fc-cc4d07120c18 req-3eaadbb6-0ae8-4e5f-a0f1-df23355fb5fc tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 210 time: 0.0419939
Jun 02 16:40:09.069813 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Request body: {'port': {'device_id': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:09.072662 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48654) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:09.091549 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:09.115936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:09.121814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Usage tracker for resource:security_group_rule and tenant:8c445b358f6e4ed19d2d9bc92bca8768 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:09.126816 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:09.134834 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:09.148473 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-8103900a-356b-4198-b684-9290e19197da service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81 HTTP/1.1" status: 200  len: 217 time: 0.1452878
Jun 02 16:40:09.163699 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-14e57310-83f9-4b0e-8ecf-bdd59b737f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.165423 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-14e57310-83f9-4b0e-8ecf-bdd59b737f37 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1096 time: 0.1610026
Jun 02 16:40:09.326303 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-d62248ef-a0cc-4d72-88a3-f089bcc980ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.327742 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-d62248ef-a0cc-4d72-88a3-f089bcc980ca service neutron] 10.222.0.20 "GET /v2.0/subnets?id=caf8e91b-8d46-4a47-a396-8ce21c092e9d HTTP/1.1" status: 200  len: 852 time: 0.1715679
Jun 02 16:40:09.386436 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-f0d9a344-53b2-469d-aafd-e040317ab275 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.388361 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-f0d9a344-53b2-469d-aafd-e040317ab275 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=2a331932fba240f7a0fbb0b93203268c&shared=False HTTP/1.1" status: 200  len: 919 time: 0.2138975
Jun 02 16:40:09.390252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:09.394601 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:09.395852 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-73fc4788-96c3-46f1-9fec-45d27d60a4c8 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8d1e36c6-d295-4363-85e5-dce458b299cc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0586197
Jun 02 16:40:09.397778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:09.405955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0f1501e3-d6dd-4c17-a723-bd3d88499a4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:09.432805 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-12e376f5-26a7-48cb-a815-944fa72e5467 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.435089 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-12e376f5-26a7-48cb-a815-944fa72e5467 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 1096 time: 0.3687520
Jun 02 16:40:09.547553 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8c445b358f6e4ed19d2d9bc92bca8768&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4738064
Jun 02 16:40:09.551646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48666) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:09.561815 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6899e175-e18e-4075-8aba-bf1748ea8c17,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:09.570625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:09.584123 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.20', 50747) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:09.791398 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-c963fa42-e4c3-444e-b6ae-f41e5a4a1b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.793904 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-deee66b2-0c06-4b1e-9dd7-0c91c976fd7f req-c963fa42-e4c3-444e-b6ae-f41e5a4a1b72 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3903475
Jun 02 16:40:09.808239 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-e338abf2-8ab6-45dc-b0af-7c67d0e7d307 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.809986 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-e338abf2-8ab6-45dc-b0af-7c67d0e7d307 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 817 time: 0.2248049
Jun 02 16:40:09.935359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-9476fd9a-518f-471c-8d84-8fd368e56cda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.936962 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-9476fd9a-518f-471c-8d84-8fd368e56cda service neutron] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 915 time: 0.4866407
Jun 02 16:40:09.944690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f970ed46-67a0-4398-ac38-fd662f12b9bc req-1867da30-3d9a-4033-9142-d785ea8a76f8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:09.950152 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f970ed46-67a0-4398-ac38-fd662f12b9bc req-1867da30-3d9a-4033-9142-d785ea8a76f8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 943 time: 0.6896653
Jun 02 16:40:09.966268 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-f51d13bb-8b4c-4857-bb12-ebf5825e034f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 379 time: 0.1468108
Jun 02 16:40:09.982284 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'port': {'device_id': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'admin_state_up': True, 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'security_groups': ['9e9b4c9b-9c70-47be-ab19-875e72ba0d3e']}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:10.086014 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-f58f46b0-e3f5-4fcc-9d36-e81d0d710d0d service neutron] 10.222.0.20 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6759574
Jun 02 16:40:10.087184 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-1008fc84-a211-4e10-9f32-98a735cad2e2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3 HTTP/1.1" status: 200  len: 217 time: 0.1169720
Jun 02 16:40:10.102212 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba355e3b-5e4c-445e-9634-f210322babac req-5377a01b-9f86-4e77-836f-3fdf59bb2892 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:10.104031 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ba355e3b-5e4c-445e-9634-f210322babac req-5377a01b-9f86-4e77-836f-3fdf59bb2892 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.2707038
Jun 02 16:40:10.146325 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-d69716f7-28ad-4ff0-a909-2126fb4994f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:10.147775 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-d69716f7-28ad-4ff0-a909-2126fb4994f4 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1096 time: 0.2757306
Jun 02 16:40:10.198551 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:10.253907 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f970ed46-67a0-4398-ac38-fd662f12b9bc req-8f01907e-cf9b-491a-9dc6-af71cb351e4d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2178009
Jun 02 16:40:10.323816 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-71361f21-971f-4ef8-8d5f-c0f510b27742 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.1612968
Jun 02 16:40:10.364228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:10.369002 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ba355e3b-5e4c-445e-9634-f210322babac req-1e1ad028-21e1-4cd7-b687-4b952adb620b tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2566969
Jun 02 16:40:10.399176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:10.414638 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-50bd69a6-368d-4763-b37c-871c8cf828cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:10.416646 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-50bd69a6-368d-4763-b37c-871c8cf828cc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.0859792
Jun 02 16:40:10.418477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Made reservation on behalf of 545e33df5ea046a0bb2be1fb482f75fb for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:10.422250 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:10.435418 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:10.489545 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-ad17064b-71a9-49c6-8e61-ca53dc88a5c1 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0485411
Jun 02 16:40:10.489733 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-2609b00f-e98d-489c-b4e9-3703ee1f6efc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:10.491528 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-2609b00f-e98d-489c-b4e9-3703ee1f6efc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.3902235
Jun 02 16:40:10.696875 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-2d3374c8-2535-4879-b6e3-8eb498937466 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1086035
Jun 02 16:40:10.765377 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-d12b7a77-5b71-4b17-ab85-84628c64caa7 service neutron] 10.222.0.20 "GET /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6654568
Jun 02 16:40:10.793080 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b26dcf1b-4952-4ad7-9084-42f011f737ce req-5bf6b7a0-8b05-4256-a579-22a1df0227ec tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 210 time: 0.1856475
Jun 02 16:40:10.853193 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-822ec6f8-8508-4bcd-86e9-6c5ac8529256 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2448032
Jun 02 16:40:10.855224 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Allocated IP 172.20.0.7 (72edfd0c-8b13-49df-90c4-bff53519faeb/5fa6f4a1-7c91-4d10-977a-c26f520b3ec0/cf7356d3-b193-4ccb-a580-fe9976ab37df) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:40:10.882067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:10.900116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f8209897-0f6b-482c-8b46-010323175ce8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:10.950618 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6899e175-e18e-4075-8aba-bf1748ea8c17,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:10.993139 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 98e1f389-92e2-4b54-838c-4df675f8b9b3 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:11.001421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:11.021448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f9889a-f770-44d7-8122-6109a3425d03 req-64a1a518-9d67-4d8a-a213-806a2294bbbf tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:11.023070 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-13f9889a-f770-44d7-8122-6109a3425d03 req-64a1a518-9d67-4d8a-a213-806a2294bbbf tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 932 time: 0.5915291
Jun 02 16:40:11.026505 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.030616 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6899e175-e18e-4075-8aba-bf1748ea8c17 HTTP/1.1" status: 204  len: 168 time: 1.4729993
Jun 02 16:40:11.033103 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-73bcb1ce-f6d9-48e4-ac64-3b59b8449c64 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3161170
Jun 02 16:40:11.055815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5e1e9de7-d161-410e-9e7e-a9f74a701739 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:11.121748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.213167 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de98a71e-5f2b-4cd0-b4e9-81cd179bf15e req-90a6c7ea-f3ad-44c7-84cc-8bc7bbcb6167 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3529289
Jun 02 16:40:11.265471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Transition to ACTIVE for port object 5e1e9de7-d161-410e-9e7e-a9f74a701739 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:11.271709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.305163 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-13f9889a-f770-44d7-8122-6109a3425d03 req-0b1c9ca5-c8aa-4a64-8834-099d1f9e3bbb tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2670865
Jun 02 16:40:11.319183 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.338197 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Transition to ACTIVE for port object cf7356d3-b193-4ccb-a580-fe9976ab37df will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:11.348106 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:11.376804 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.407707 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:11.428933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:11.491033 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '98e1f389-92e2-4b54-838c-4df675f8b9b3', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'port_id': '98e1f389-92e2-4b54-838c-4df675f8b9b3', 'mac_address': 'fa:16:3e:57:b7:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 679, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '409c7043-b3b6-42f7-90b5-f7db5d717e70', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:11.621981 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:40:11.625283 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.634854 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:11.641949 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:40:11.642040 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Pushing event updated for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:11.647451 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:11.648081 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.653405 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:11.694220 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 98e1f389-92e2-4b54-838c-4df675f8b9b3 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:11.712904 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:11.719924 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:11.733842 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:11.740595 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.741350 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adaa7944-ce71-4265-bd85-afb28a3d7c81 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:11.743526 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:11.756884 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acea1593-1d98-44b2-a2d9-42075d617df6 req-fd114a44-aaf4-4b35-a9ac-03980e16f662 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:11.769596 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acea1593-1d98-44b2-a2d9-42075d617df6 req-fd114a44-aaf4-4b35-a9ac-03980e16f662 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 943 time: 0.2515991
Jun 02 16:40:11.794213 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.8193717
Jun 02 16:40:11.818934 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-edf7f27c-cea6-4c03-8c85-440df073b2d9 req-e9de2dbb-ff8e-43ef-9a50-dfc5978782bf service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7767789
Jun 02 16:40:11.827938 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Request body: {'port': {'device_id': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:11.866798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Attempting to bind port 5e1e9de7-d161-410e-9e7e-a9f74a701739 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:11.867283 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Attempting to bind port 5e1e9de7-d161-410e-9e7e-a9f74a701739 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:11.867735 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Attempting to bind port 5e1e9de7-d161-410e-9e7e-a9f74a701739 on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:11.875388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Port 5e1e9de7-d161-410e-9e7e-a9f74a701739 on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:11.875861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Attempting to bind port 5e1e9de7-d161-410e-9e7e-a9f74a701739 on network 1f2f7c0d-7d36-4292-bab6-39e7de3c95ef {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:11.887565 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:11.888014 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Checking segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:11.888511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Bound using segment: {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:11.889055 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Bound port: 5e1e9de7-d161-410e-9e7e-a9f74a701739, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '27a32301-de09-4cde-a3f0-526d03f25ea3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:11.889508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:11.897287 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:11.903317 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:11.977214 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea1f7e4-3b50-4274-916c-2303c6786759 req-a2cee22b-d4a1-4412-8b32-62a9e113d4a3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:11.979724 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4ea1f7e4-3b50-4274-916c-2303c6786759 req-a2cee22b-d4a1-4412-8b32-62a9e113d4a3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 944 time: 0.3243475
Jun 02 16:40:12.027597 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acea1593-1d98-44b2-a2d9-42075d617df6 req-8c7c52be-4611-4907-bbc2-78d1f9bf322c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2571032
Jun 02 16:40:12.045377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81,segment=NetworkSegment(a06ec11a-1aa9-49e2-824a-cb70c50736bf),segment_id=a06ec11a-1aa9-49e2-824a-cb70c50736bf)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:12.064074 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.066690 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'adaa7944-ce71-4265-bd85-afb28a3d7c81', 'network_id': '8d1e36c6-d295-4363-85e5-dce458b299cc', 'port_id': 'adaa7944-ce71-4265-bd85-afb28a3d7c81', 'mac_address': 'fa:16:3e:b0:5a:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'caf8e91b-8d46-4a47-a396-8ce21c092e9d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:12.072350 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fbefe654-3819-4013-b5cc-ea76190b7916 None None] Provisioning for port cf7356d3-b193-4ccb-a580-fe9976ab37df completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:12.118881 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4ea1f7e4-3b50-4274-916c-2303c6786759 req-74e4e718-1212-4380-b545-7ee8729d3be1 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1240711
Jun 02 16:40:12.136071 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fbefe654-3819-4013-b5cc-ea76190b7916 None None] Provisioning complete for port cf7356d3-b193-4ccb-a580-fe9976ab37df triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:12.136680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fbefe654-3819-4013-b5cc-ea76190b7916 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.166396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:12.170800 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:12.180304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.188970 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:12.219545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.239118 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id adaa7944-ce71-4265-bd85-afb28a3d7c81 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:12.243781 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-fbefe654-3819-4013-b5cc-ea76190b7916 None None] Port cf7356d3-b193-4ccb-a580-fe9976ab37df cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:40:12.260752 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81,segment=NetworkSegment(a06ec11a-1aa9-49e2-824a-cb70c50736bf),segment_id=a06ec11a-1aa9-49e2-824a-cb70c50736bf)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:12.270604 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.273025 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:12.286029 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:12.287232 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.289148 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] 10.222.0.20 "PUT /v2.0/ports/5e1e9de7-d161-410e-9e7e-a9f74a701739 HTTP/1.1" status: 200  len: 1094 time: 3.2844753
Jun 02 16:40:12.289891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:12.293016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b17f0464-3693-4105-ae37-0e06473d17ee" -d '{"events": [{"name": "network-changed", "server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:12.347188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Pushing event updated for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:12.352301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:12.352934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:12.357149 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:12.418817 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dabb8a00-6d60-4890-922e-91f3a50baebc x-openstack-request-id: req-dabb8a00-6d60-4890-922e-91f3a50baebc {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:12.419221 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:12.419437 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e03381-b8a5-4960-9e0f-8895f6b700a8 req-b482a01c-921a-4c1a-9d19-485478bd15b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:12.419654 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-dabb8a00-6d60-4890-922e-91f3a50baebc {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:12.420143 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739', 'status': 'completed', 'code': 200}
Jun 02 16:40:12.420249 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-e6e03381-b8a5-4960-9e0f-8895f6b700a8 req-b482a01c-921a-4c1a-9d19-485478bd15b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:12.492725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48774) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:12.502418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-e6e03381-b8a5-4960-9e0f-8895f6b700a8 req-b482a01c-921a-4c1a-9d19-485478bd15b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:12.503557 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6e03381-b8a5-4960-9e0f-8895f6b700a8 req-b482a01c-921a-4c1a-9d19-485478bd15b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 931 time: 0.2842114
Jun 02 16:40:12.569340 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6e03381-b8a5-4960-9e0f-8895f6b700a8 req-ea135fb9-64d1-4a36-a1d6-8de7bf51a921 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0542507
Jun 02 16:40:12.596294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ab48a5-57bb-4d48-9eab-aa1bcb69d40a req-19650649-961a-466e-a30b-46c91520370c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:12.598050 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-11ab48a5-57bb-4d48-9eab-aa1bcb69d40a req-19650649-961a-466e-a30b-46c91520370c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.0889668
Jun 02 16:40:12.629033 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1348736081-network', 'tenant_id': '3747befb35a14028a0d6f65f3cab9553'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:12.645475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:12.652587 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Usage tracker for resource:network and tenant:3747befb35a14028a0d6f65f3cab9553 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:12.657129 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:12.665952 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:12.669336 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:12.679731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.697894 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Transition to ACTIVE for port object cf7356d3-b193-4ccb-a580-fe9976ab37df will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:12.699848 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Made reservation on behalf of 3747befb35a14028a0d6f65f3cab9553 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:12.702272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.716302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.727816 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:12.738621 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ba626887-5872-4203-b08b-45145418a67c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:12.771065 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-11ab48a5-57bb-4d48-9eab-aa1bcb69d40a req-510de464-5ddc-4077-8cab-84e3d17e2027 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1600893
Jun 02 16:40:12.777649 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:12.867378 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Usage tracker for resource:security_group_rule and tenant:3747befb35a14028a0d6f65f3cab9553 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:12.871713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:12.925795 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:13.002693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:13.011075 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:13.033965 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Attempting to bind port cf7356d3-b193-4ccb-a580-fe9976ab37df on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:13.034298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Attempting to bind port cf7356d3-b193-4ccb-a580-fe9976ab37df by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:13.034664 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Attempting to bind port cf7356d3-b193-4ccb-a580-fe9976ab37df on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:13.043659 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Port cf7356d3-b193-4ccb-a580-fe9976ab37df on network 72edfd0c-8b13-49df-90c4-bff53519faeb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:13.043659 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Attempting to bind port cf7356d3-b193-4ccb-a580-fe9976ab37df on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:13.054300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:13.054634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Checking segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:13.055010 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Bound using segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:13.055443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Bound port: cf7356d3-b193-4ccb-a580-fe9976ab37df, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:13.055862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.230410 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:13.234753 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.246073 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.248355 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:13.261231 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f777b3c7-d427-4d39-9960-b002f1a6699c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:13.271676 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.296222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] vlan segment allocate from pool success with {'vlan_id': 661, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:40:13.328443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c100486-50da-4956-8877-bc3b6150249a,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:13.328443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.328443 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Added segment 2a3b7d6f-3bce-424d-998a-2b62194e256e of type vlan for network 532c19ad-7fb3-433c-aca6-49e204fc4e0a
Jun 02 16:40:13.332888 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.333473 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.334949 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] 10.222.0.20 "PUT /v2.0/ports/cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 200  len: 1093 time: 1.5269709
Jun 02 16:40:13.336554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:13.337297 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:13.339487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf695914-a18f-40a3-9fdd-44425542d93e" -d '{"events": [{"name": "network-changed", "server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:13.342734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.047s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:13.375757 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f41af48-5b48-46b6-8f8a-01ea53368b50 req-c9ef4c83-1c68-47e4-b703-5ebf9f750b7c tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.385988 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0f41af48-5b48-46b6-8f8a-01ea53368b50 req-c9ef4c83-1c68-47e4-b703-5ebf9f750b7c tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 945 time: 0.1406443
Jun 02 16:40:13.415129 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9730c075-f392-43e4-8d6c-b788cf01af42 req-ad8d16ad-d0e9-4a84-953f-e48b1eca70e7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.416699 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9730c075-f392-43e4-8d6c-b788cf01af42 req-ad8d16ad-d0e9-4a84-953f-e48b1eca70e7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 944 time: 0.2619586
Jun 02 16:40:13.450257 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0f41af48-5b48-46b6-8f8a-01ea53368b50 req-bca614c3-d099-41fb-847c-e5d1aa1774b8 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0627646
Jun 02 16:40:13.459806 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.512801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:13.525237 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9730c075-f392-43e4-8d6c-b788cf01af42 req-48299cff-4b5a-499a-8083-f98257a55cec tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0912120
Jun 02 16:40:13.526060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:13.540193 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50d2a701-6c75-452e-979b-73fa68023a3f x-openstack-request-id: req-50d2a701-6c75-452e-979b-73fa68023a3f {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:13.540495 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:13.540827 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-50d2a701-6c75-452e-979b-73fa68023a3f {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:13.541174 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'status': 'completed', 'code': 200}
Jun 02 16:40:13.542551 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.544046 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.544618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.550380 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-10d40606-00e8-4f94-837a-0b30c4fa6b1d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:13.663328 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1695275
Jun 02 16:40:13.666798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48816) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:13.669021 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Pushing event updated for resources: {'Network': ['ID=532c19ad-7fb3-433c-aca6-49e204fc4e0a,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:13.671982 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:13.672931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Request body: {'subnet': {'network_id': '532c19ad-7fb3-433c-aca6-49e204fc4e0a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1348736081-subnet', 'tenant_id': '3747befb35a14028a0d6f65f3cab9553', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:13.678581 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:13.680233 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 532c19ad-7fb3-433c-aca6-49e204fc4e0a details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:40:13.684219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Usage tracker for resource:subnet and tenant:3747befb35a14028a0d6f65f3cab9553 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:13.688723 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:13.697397 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:13.721451 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Made reservation on behalf of 3747befb35a14028a0d6f65f3cab9553 for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:13.725001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Notify callbacks [] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:13.927936 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bca664e-1225-4c8c-8222-7a3655be4c19 req-ddeffd43-f0e3-4f75-9e96-5e57aea09fbf tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.928702 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9bca664e-1225-4c8c-8222-7a3655be4c19 req-ddeffd43-f0e3-4f75-9e96-5e57aea09fbf tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1842160
Jun 02 16:40:13.963050 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-120d237b-5269-4f05-b7fa-02a0e35ec2b1 req-ee3eb041-96c8-46b7-a7fc-3fa120bbc6a0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:13.970332 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-120d237b-5269-4f05-b7fa-02a0e35ec2b1 req-ee3eb041-96c8-46b7-a7fc-3fa120bbc6a0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.0900862
Jun 02 16:40:14.017817 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-9bca664e-1225-4c8c-8222-7a3655be4c19 req-c65902c3-489e-49ca-8cbc-89d4a826cbf7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:14.018742 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-120d237b-5269-4f05-b7fa-02a0e35ec2b1 req-7f1e809d-5968-47f7-aa98-3d315cba8975 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471761
Jun 02 16:40:14.070272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-9bca664e-1225-4c8c-8222-7a3655be4c19 req-c65902c3-489e-49ca-8cbc-89d4a826cbf7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:14.071420 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9bca664e-1225-4c8c-8222-7a3655be4c19 req-c65902c3-489e-49ca-8cbc-89d4a826cbf7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1348464
Jun 02 16:40:14.275086 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:14.279070 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:14.348564 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=642fb54f-8889-4243-b7e2-ba5e1dc643e6,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:14.354323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:14.360991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Checking segment: {'id': '2a3b7d6f-3bce-424d-998a-2b62194e256e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 661, 'network_id': '532c19ad-7fb3-433c-aca6-49e204fc4e0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:14.361212 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Network hostable DHCP agents. Network: 532c19ad-7fb3-433c-aca6-49e204fc4e0a, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:40:14.381481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Network 532c19ad-7fb3-433c-aca6-49e204fc4e0a is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:40:14.391061 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 532c19ad-7fb3-433c-aca6-49e204fc4e0a) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:14.395717 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:14.396315 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:14.406145 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-936b9d64-fd7b-4a9e-8f41-9face7a35878 None None] Network 532c19ad-7fb3-433c-aca6-49e204fc4e0a requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:40:14.420382 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-d5d5c3b4-f3dc-48f7-9df2-76df4233e3bd admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.7523735
Jun 02 16:40:14.665973 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb4b9047-b798-43de-aa62-5ed0e19f88b2 req-a8c668c4-9cf8-4e9c-bc84-12da2d600e77 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:14.668035 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb4b9047-b798-43de-aa62-5ed0e19f88b2 req-a8c668c4-9cf8-4e9c-bc84-12da2d600e77 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 945 time: 0.0981123
Jun 02 16:40:14.686508 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b103129-106a-4cc4-aabd-3c99d0a3cbb2 None None] Network 532c19ad-7fb3-433c-aca6-49e204fc4e0a requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:40:14.738781 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb4b9047-b798-43de-aa62-5ed0e19f88b2 req-ee460d3c-8c85-42df-963d-39ab146a68d3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517046
Jun 02 16:40:14.779277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80e243d-2870-4e75-b1fb-8b0478c7e274 req-ffb9a26c-e9f1-4e0b-8274-cbf17b0ffbc5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:14.788000 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e80e243d-2870-4e75-b1fb-8b0478c7e274 req-ffb9a26c-e9f1-4e0b-8274-cbf17b0ffbc5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 944 time: 0.1113708
Jun 02 16:40:14.833086 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e80e243d-2870-4e75-b1fb-8b0478c7e274 req-352e668b-f3bb-4426-b3b1-4ade7436bc1f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439305
Jun 02 16:40:15.081182 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48854) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:15.091301 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-313816081-network', 'tenant_id': 'b9982fccfaba4b8280277f3a8047b841'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:15.171058 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:15.195618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Usage tracker for resource:network and tenant:b9982fccfaba4b8280277f3a8047b841 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:15.204420 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:15.224307 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:15.281125 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Made reservation on behalf of b9982fccfaba4b8280277f3a8047b841 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:15.292618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:15.296039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf695914-a18f-40a3-9fdd-44425542d93e req-acbf5a41-0691-4447-a1d1-95ebc0408939 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:15.300070 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf695914-a18f-40a3-9fdd-44425542d93e req-acbf5a41-0691-4447-a1d1-95ebc0408939 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1096 time: 0.1803188
Jun 02 16:40:15.327158 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:15.404295 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:15.414989 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17f0464-3693-4105-ae37-0e06473d17ee req-d3ea38dd-19c6-4b31-a71a-1d1cf28af385 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:15.416486 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b17f0464-3693-4105-ae37-0e06473d17ee req-d3ea38dd-19c6-4b31-a71a-1d1cf28af385 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1097 time: 0.3189895
Jun 02 16:40:15.417454 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Usage tracker for resource:security_group_rule and tenant:b9982fccfaba4b8280277f3a8047b841 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:15.421416 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:15.445507 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['adaa7944-ce71-4265-bd85-afb28a3d7c81'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:15.518413 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:15.565901 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf695914-a18f-40a3-9fdd-44425542d93e req-3834600d-9a4f-42e0-853e-ef7d7d571062 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:15.565901 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf695914-a18f-40a3-9fdd-44425542d93e req-3834600d-9a4f-42e0-853e-ef7d7d571062 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&shared=False HTTP/1.1" status: 200  len: 918 time: 0.2563648
Jun 02 16:40:15.653063 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d74b23-1be8-49c1-bccb-091d6b46b815 req-d2a885fc-a6a6-4a19-8a01-10485018845a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:15.654319 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a1d74b23-1be8-49c1-bccb-091d6b46b815 req-d2a885fc-a6a6-4a19-8a01-10485018845a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2834616
Jun 02 16:40:15.692845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17f0464-3693-4105-ae37-0e06473d17ee req-a107ca05-b293-420c-a209-7333c3e1cab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:15.695382 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b17f0464-3693-4105-ae37-0e06473d17ee req-a107ca05-b293-420c-a209-7333c3e1cab0 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=2a331932fba240f7a0fbb0b93203268c&shared=False HTTP/1.1" status: 200  len: 919 time: 0.2691259
Jun 02 16:40:15.699142 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:15.918851 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a1d74b23-1be8-49c1-bccb-091d6b46b815 req-59b4e252-fe28-4c1c-b523-8f212fef6df4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2390783
Jun 02 16:40:16.001226 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be4549a-b832-4f93-915b-8c38b0a799d8 req-89764b83-220a-45f2-9ca9-10ee4c530bc0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.002899 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4be4549a-b832-4f93-915b-8c38b0a799d8 req-89764b83-220a-45f2-9ca9-10ee4c530bc0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.6609380
Jun 02 16:40:16.030314 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf695914-a18f-40a3-9fdd-44425542d93e req-1748a082-f6b7-4bd7-b23a-e0559589b015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.034757 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf695914-a18f-40a3-9fdd-44425542d93e req-1748a082-f6b7-4bd7-b23a-e0559589b015 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.4587579
Jun 02 16:40:16.094470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17f0464-3693-4105-ae37-0e06473d17ee req-52656db3-40ff-42b2-9a85-52a165be371f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.096044 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b17f0464-3693-4105-ae37-0e06473d17ee req-52656db3-40ff-42b2-9a85-52a165be371f service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3887467
Jun 02 16:40:16.111620 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4be4549a-b832-4f93-915b-8c38b0a799d8 req-c7ca63b2-efc4-4e86-ad2f-fd9d7a566d36 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0968504
Jun 02 16:40:16.151319 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.201741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.213394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:16.252188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] vlan segment allocate from pool success with {'vlan_id': 672, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:40:16.261175 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=846e75d3-c46e-4661-9245-5a22a6e4f060,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:16.262231 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-eb2aa5a9-09b7-474e-b0ba-1c2c7815b76c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.263934 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-eb2aa5a9-09b7-474e-b0ba-1c2c7815b76c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1096 time: 0.1470702
Jun 02 16:40:16.281247 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:16.316352 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.316352 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Added segment b119e8e7-4188-48b1-8aab-e1ff1eb5323d of type vlan for network a66579cc-0355-4898-a988-bc6983920587
Jun 02 16:40:16.390976 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93f43c0-9ccd-4ac3-9d9f-610a85284b47 req-a0e4aea0-ae1d-47b4-991d-556acf7a1863 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.398282 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d93f43c0-9ccd-4ac3-9d9f-610a85284b47 req-a0e4aea0-ae1d-47b4-991d-556acf7a1863 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 945 time: 0.3365386
Jun 02 16:40:16.449440 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-58932efd-62b4-464f-b432-389b50e01f70 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 200  len: 217 time: 0.1733418
Jun 02 16:40:16.486823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.511038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-15a78057-9237-478f-9a3a-b2a1cde45b01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.512908 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-15a78057-9237-478f-9a3a-b2a1cde45b01 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1097 time: 0.3553832
Jun 02 16:40:16.531762 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d93f43c0-9ccd-4ac3-9d9f-610a85284b47 req-beb45eb2-f250-4e23-aa02-9f3fbee51b91 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1321774
Jun 02 16:40:16.574584 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-01090836-702d-4a88-8767-6d24ad5d4033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.576156 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-01090836-702d-4a88-8767-6d24ad5d4033 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.1197464
Jun 02 16:40:16.692374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-7ebee8a0-bba6-4d28-b758-c322834681c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.694413 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-7ebee8a0-bba6-4d28-b758-c322834681c7 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1085241
Jun 02 16:40:16.726984 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-97ece74a-a126-4718-a3b0-3c7ce7ac2e18 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739 HTTP/1.1" status: 200  len: 217 time: 0.2033048
Jun 02 16:40:16.730307 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.db.resource_extend [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:40:16.881428 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556eed97-2672-42b9-b51f-162778fff668 req-be062917-6cfa-4cde-b229-24d341b2a582 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.884417 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-556eed97-2672-42b9-b51f-162778fff668 req-be062917-6cfa-4cde-b229-24d341b2a582 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 944 time: 0.4979515
Jun 02 16:40:16.894674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.904222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.905342 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:16.939822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:16.940552 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-1a9b059e-9d71-4dab-8da9-c8e61225b9ba service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2387354
Jun 02 16:40:16.982638 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-0e3d3bb9-608d-46e5-ac08-215d047fd66d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:16.986448 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-0e3d3bb9-608d-46e5-ac08-215d047fd66d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.2429242
Jun 02 16:40:17.068087 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device b28c3bf7-7098-48bc-8c31-211ba369c5bf details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:17.072198 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 98e1f389-92e2-4b54-838c-4df675f8b9b3 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:17.129523 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-086cc398-e5dd-44ae-8a86-a8e981130d1a service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1214471
Jun 02 16:40:17.189312 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 2.1067846
Jun 02 16:40:17.202686 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-556eed97-2672-42b9-b51f-162778fff668 req-69e8b4d2-061f-403d-9304-b50453a0670c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3061502
Jun 02 16:40:17.208188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48904) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:17.209279 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71e4548d-1eb4-4906-b31a-3981e4523c0d req-f7f43d1b-31b6-416b-90d0-c242863ff1ce service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2611229
Jun 02 16:40:17.263792 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Request body: {'subnet': {'network_id': 'a66579cc-0355-4898-a988-bc6983920587', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-313816081-subnet', 'tenant_id': 'b9982fccfaba4b8280277f3a8047b841', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:17.267913 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Pushing event updated for resources: {'Network': ['ID=a66579cc-0355-4898-a988-bc6983920587,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:17.275704 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.336s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:17.280822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:17.306782 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network a66579cc-0355-4898-a988-bc6983920587 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:40:17.314464 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Usage tracker for resource:subnet and tenant:b9982fccfaba4b8280277f3a8047b841 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:17.319222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:17.362248 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36da0dda-7a10-4ba1-8772-9bfc6bd35e65 req-46c1846c-abbf-4084-82c1-f3c96727fa67 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:17.364194 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-36da0dda-7a10-4ba1-8772-9bfc6bd35e65 req-46c1846c-abbf-4084-82c1-f3c96727fa67 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2983003
Jun 02 16:40:17.374937 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:17.413736 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Made reservation on behalf of b9982fccfaba4b8280277f3a8047b841 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:17.416184 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:17.467363 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-36da0dda-7a10-4ba1-8772-9bfc6bd35e65 req-ecf4380d-24fe-44b1-8614-79fb62a49183 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0966306
Jun 02 16:40:17.531692 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-ae9f8434-8faa-4ff1-9595-4185b2c4566d service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3443062
Jun 02 16:40:17.591124 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 98e1f389-92e2-4b54-838c-4df675f8b9b3 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:17.616367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 98e1f389-92e2-4b54-838c-4df675f8b9b3 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:17.616740 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:17.710274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:17.736255 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0913d122-98f7-407a-a209-239b8ef87ea2 req-b01b68b2-a6e3-4f6b-8ca3-c9206a3ebfeb service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1562033
Jun 02 16:40:17.786117 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'port_id': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf', 'mac_address': 'fa:16:3e:cc:e7:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:17.800527 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b388427a-f4b7-45dd-af3f-b88826428cf3 req-f3249d40-ac5e-437f-99fc-b155b458c619 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:17.807503 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b388427a-f4b7-45dd-af3f-b88826428cf3 req-f3249d40-ac5e-437f-99fc-b155b458c619 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.3266208
Jun 02 16:40:17.896735 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b388427a-f4b7-45dd-af3f-b88826428cf3 req-8b3d90fb-e60f-4c07-b3c8-6dd5241b9559 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0882459
Jun 02 16:40:17.994119 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860cb3de-6f8f-4260-92dd-11fe69a90a56 req-3a91c1bf-bfa0-4d57-bfbc-b4cfc4337e3a tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:17.995765 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-860cb3de-6f8f-4260-92dd-11fe69a90a56 req-3a91c1bf-bfa0-4d57-bfbc-b4cfc4337e3a tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 945 time: 0.1917899
Jun 02 16:40:18.014262 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.066985 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b28c3bf7-7098-48bc-8c31-211ba369c5bf {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:18.075382 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.117120 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-860cb3de-6f8f-4260-92dd-11fe69a90a56 req-ea1c6bca-f03e-4913-8d93-026ebf538eed tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1096792
Jun 02 16:40:18.128165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:18.144195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:18.207367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.210584 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:18.245385 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:18.265171 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.266141 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adaa7944-ce71-4265-bd85-afb28a3d7c81 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:18.352134 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:18.356676 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:18.357274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.055s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:18.438634 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port adaa7944-ce71-4265-bd85-afb28a3d7c81 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:18.454654 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:18.463790 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port adaa7944-ce71-4265-bd85-afb28a3d7c81 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:18.464168 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.493375 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:18.496706 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-30ae59e7-2c9e-44e2-82fc-3bda563d4eee" -d '{"events": [{"server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "name": "network-vif-plugged", "status": "completed", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:18.499628 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['b28c3bf7-7098-48bc-8c31-211ba369c5bf'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:18.505522 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.522575 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:18.624474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Pushing event updated for resources: {'Subnet': ['ID=40833f12-9d12-443c-9fc7-58161f52c517,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:18.631903 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:18.650459 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e426a1a-ab15-480a-b445-26ae5508c51a req-bde414f4-efba-4c79-a03d-610f4d1e0849 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:18.652236 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e426a1a-ab15-480a-b445-26ae5508c51a req-bde414f4-efba-4c79-a03d-610f4d1e0849 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1883230
Jun 02 16:40:18.653310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Checking segment: {'id': 'b119e8e7-4188-48b1-8aab-e1ff1eb5323d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'a66579cc-0355-4898-a988-bc6983920587'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:18.653689 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Network hostable DHCP agents. Network: a66579cc-0355-4898-a988-bc6983920587, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:40:18.733207 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e426a1a-ab15-480a-b445-26ae5508c51a req-f25a873b-9da7-4573-91d3-97e56115a796 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0732732
Jun 02 16:40:18.733926 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Network a66579cc-0355-4898-a988-bc6983920587 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:40:18.749253 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, a66579cc-0355-4898-a988-bc6983920587) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:18.755905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:18.756495 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.776847 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0496ee1b-915c-4936-ac19-b534fcf6dddf None None] Network a66579cc-0355-4898-a988-bc6983920587 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:40:18.803960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-639513aa-c42f-48a3-b9ac-9c28c729a2a2 req-1e3a300d-aa21-4675-a3a3-207eab3c5220 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:18.813596 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-639513aa-c42f-48a3-b9ac-9c28c729a2a2 req-1e3a300d-aa21-4675-a3a3-207eab3c5220 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1510594
Jun 02 16:40:18.822653 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-cf6ace1d-67ba-4dfd-9e19-4ba71fca7394 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.5654695
Jun 02 16:40:18.887284 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:18.895105 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-639513aa-c42f-48a3-b9ac-9c28c729a2a2 req-8824e91d-aea9-4f97-9c14-7bd464c8fca1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0800951
Jun 02 16:40:19.105699 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5094c9f8-3db5-43ce-9eff-5f39dbd17e41 x-openstack-request-id: req-5094c9f8-3db5-43ce-9eff-5f39dbd17e41 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:19.106665 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "name": "network-vif-plugged", "status": "completed", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:19.107122 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-5094c9f8-3db5-43ce-9eff-5f39dbd17e41 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:19.107760 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3', 'code': 200}
Jun 02 16:40:19.129356 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81,segment=NetworkSegment(a06ec11a-1aa9-49e2-824a-cb70c50736bf),segment_id=a06ec11a-1aa9-49e2-824a-cb70c50736bf)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:19.131621 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48958) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:19.277538 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.287597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:19.344803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.366044 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:19.372064 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Usage tracker for resource:security_group_rule and tenant:f10df6b05b65491094232571d03f83bc is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:19.376888 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:19.385029 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:19.400146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cc5210-9f1e-40ac-aac5-20f524cb6543 req-cdd2b2ac-5331-4b99-b011-cbccf1ece01c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:19.401763 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e8cc5210-9f1e-40ac-aac5-20f524cb6543 req-cdd2b2ac-5331-4b99-b011-cbccf1ece01c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.1780107
Jun 02 16:40:19.473091 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d7176e-3d5a-4075-b204-162e36624bfb req-0958c585-3242-43dc-96cd-bf3240fcaa4c tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:19.476026 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e8cc5210-9f1e-40ac-aac5-20f524cb6543 req-86a993cd-e14c-4f03-8c58-93d493324d6b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581892
Jun 02 16:40:19.483186 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4fa691f-b0dc-45f6-92e8-59881cd9efc3 None None] Network a66579cc-0355-4898-a988-bc6983920587 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:40:19.484827 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3d7176e-3d5a-4075-b204-162e36624bfb req-0958c585-3242-43dc-96cd-bf3240fcaa4c tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.1261761
Jun 02 16:40:19.547647 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3d7176e-3d5a-4075-b204-162e36624bfb req-7f2bba0b-3464-43bc-a09e-61b0e3aefc57 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610800
Jun 02 16:40:19.610680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.616113 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.646508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:19.659614 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48972) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:19.672429 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f10df6b05b65491094232571d03f83bc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5389497
Jun 02 16:40:19.683627 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:19.704781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d28da12e-376c-4c36-bcbe-cea8a4c69188,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:19.704963 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:19.709280 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:19.742872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.785188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.851546 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.856154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ecec9fad-4ae0-4f4a-b2c1-07526ebc1746 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:19.870525 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d28da12e-376c-4c36-bcbe-cea8a4c69188,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:19.873165 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:19.874412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:19.877714 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d28da12e-376c-4c36-bcbe-cea8a4c69188 HTTP/1.1" status: 204  len: 168 time: 0.2146652
Jun 02 16:40:19.981908 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b626d32-ac8c-4d28-8f15-c21d0fd706ae req-9214bcb3-08fc-4c22-988e-3d42b9eb4e0c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:19.984738 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b626d32-ac8c-4d28-8f15-c21d0fd706ae req-9214bcb3-08fc-4c22-988e-3d42b9eb4e0c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1008825
Jun 02 16:40:20.054907 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b626d32-ac8c-4d28-8f15-c21d0fd706ae req-495b386c-00c2-47e5-93a7-a16849ddad92 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618806
Jun 02 16:40:20.099061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec77684-2a51-4cca-ba12-ea3cd276bcd5 req-c64ffdcb-a1b7-447a-8c88-458b0c49fa3d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:20.100635 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0ec77684-2a51-4cca-ba12-ea3cd276bcd5 req-c64ffdcb-a1b7-447a-8c88-458b0c49fa3d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0982401
Jun 02 16:40:20.181383 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0ec77684-2a51-4cca-ba12-ea3cd276bcd5 req-9da36c69-489c-40e1-8bd2-511aa8a418a6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0684886
Jun 02 16:40:20.312771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 48988) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:20.330025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.344585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:20.348807 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Usage tracker for resource:security_group_rule and tenant:d7812162adc54a86877b81d2520d0a63 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:20.351991 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:20.358370 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:20.457597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.462556 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.470095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-54f34861-087d-48e5-a781-9420e08a0744 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:20.511123 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d7812162adc54a86877b81d2520d0a63&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1972222
Jun 02 16:40:20.512013 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cedc10b7-ffe7-44c6-bc40-6134041cc8b6,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:20.514007 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 48992) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:20.515023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:20.581693 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.611483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.741799 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958c88e8-ed10-4425-8f81-bbf61e9567e9 req-745a07ce-4d5f-4781-9a6a-e4d9948568b0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:20.743567 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-958c88e8-ed10-4425-8f81-bbf61e9567e9 req-745a07ce-4d5f-4781-9a6a-e4d9948568b0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.0945888
Jun 02 16:40:20.774164 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.792538 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:20.839384 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cedc10b7-ffe7-44c6-bc40-6134041cc8b6,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:20.840762 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd02589-9a06-48ad-81e1-f6aafdab28d2 req-a0222e91-0871-4e58-9d73-f13a54053e9d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:20.842291 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dbd02589-9a06-48ad-81e1-f6aafdab28d2 req-a0222e91-0871-4e58-9d73-f13a54053e9d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.1715007
Jun 02 16:40:20.842506 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:20.860130 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-958c88e8-ed10-4425-8f81-bbf61e9567e9 req-5bde2d09-3910-4494-acc8-4f27307e8ab0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1093509
Jun 02 16:40:20.862644 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:20.876544 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cedc10b7-ffe7-44c6-bc40-6134041cc8b6 HTTP/1.1" status: 204  len: 168 time: 0.3513677
Jun 02 16:40:20.909868 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dbd02589-9a06-48ad-81e1-f6aafdab28d2 req-9b37d346-88ae-4a1a-bbe0-f90a883a5ace tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0608532
Jun 02 16:40:21.110048 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:21.113483 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5553556e-0757-4903-b126-784fa9e10802" -d '{"events": [{"server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "name": "network-vif-plugged", "status": "completed", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:21.169873 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c23edacc-2cb5-4c68-9822-72d447ad852c x-openstack-request-id: req-c23edacc-2cb5-4c68-9822-72d447ad852c {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:21.170232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "name": "network-vif-plugged", "status": "completed", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:21.170704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c23edacc-2cb5-4c68-9822-72d447ad852c {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:21.171162 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81', 'code': 200}
Jun 02 16:40:21.278181 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f22278-eeb5-4ffb-a17f-e248c87e5c70 req-f00a23fa-3eb8-4bd4-ac12-d6db112ba48d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:21.279757 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d4f22278-eeb5-4ffb-a17f-e248c87e5c70 req-f00a23fa-3eb8-4bd4-ac12-d6db112ba48d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1006069
Jun 02 16:40:21.285253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49010) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:21.320243 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.352192 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:21.360487 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d4f22278-eeb5-4ffb-a17f-e248c87e5c70 req-e2bde5b5-c469-478e-b43c-767edc8bcbe0 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0611897
Jun 02 16:40:21.361333 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Usage tracker for resource:security_group_rule and tenant:a067242c835f4595a48f9327d25802e6 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:21.364583 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:21.370997 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:21.436124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f3b1d70-e9cd-4ad6-825a-ccf3fbfac32d req-97f8c1df-dcbb-4448-85a3-047cae07c068 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:21.437716 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2f3b1d70-e9cd-4ad6-825a-ccf3fbfac32d req-97f8c1df-dcbb-4448-85a3-047cae07c068 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1054761
Jun 02 16:40:21.493212 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2f3b1d70-e9cd-4ad6-825a-ccf3fbfac32d req-cf3b3a89-4c3e-4b21-a037-e5a5d0ad087c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0456867
Jun 02 16:40:21.493439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.499423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.507370 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e2510407-a273-4c87-863e-88955a0ce674 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:21.549246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d078a8e-da85-493b-bf55-84cc401ff700,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:21.553623 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a067242c835f4595a48f9327d25802e6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2672944
Jun 02 16:40:21.554603 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:21.556348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49018) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:21.609384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:21.621511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.655160 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.793670 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.800131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:21.811113 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d078a8e-da85-493b-bf55-84cc401ff700,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:21.813688 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:21.820054 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:21.828153 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2d078a8e-da85-493b-bf55-84cc401ff700 HTTP/1.1" status: 204  len: 168 time: 0.2684698
Jun 02 16:40:21.873440 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:21.899249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:21.999979 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-57e095dd-b5d5-4db9-ad63-339540e01424 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.003199 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-57e095dd-b5d5-4db9-ad63-339540e01424 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 1098 time: 0.1494999
Jun 02 16:40:22.012709 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-a1719216-a35a-407b-81b1-cf07213cef77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.014938 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-a1719216-a35a-407b-81b1-cf07213cef77 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 1099 time: 0.1136017
Jun 02 16:40:22.032309 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.042232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.049362 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:22.054982 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Usage tracker for resource:security_group_rule and tenant:90adabc121ea41c8a95252bc1c7291c2 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:22.059206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:22.069176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:22.091901 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:22.124217 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:22.130022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.134888 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.136244 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 5e1e9de7-d161-410e-9e7e-a9f74a701739 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:22.140099 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-055c8d59-b6a0-4232-ae32-419963b98acb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:22.184123 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:22.194346 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Usage tracker for resource:security_group_rule and tenant:90adabc121ea41c8a95252bc1c7291c2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:22.204200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:22.247321 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:22.261661 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.284482 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aac548a-31bc-4b1e-8d8f-ce82f255f10a req-f4181583-890b-47e7-9883-7cda6706f909 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.286319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:22.294197 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:22.298249 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1aac548a-31bc-4b1e-8d8f-ce82f255f10a req-f4181583-890b-47e7-9883-7cda6706f909 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.1653621
Jun 02 16:40:22.299206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.324430 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-214dd431-f130-4683-b3dd-bfc5d19783b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:22.327211 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a75914-47e6-4ac3-afe2-16e86966465e req-46009f15-969c-48a8-af43-a88452b84643 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.329224 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99a75914-47e6-4ac3-afe2-16e86966465e req-46009f15-969c-48a8-af43-a88452b84643 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 944 time: 0.3076246
Jun 02 16:40:22.335410 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.db.api [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Retry wrapper got retriable exception: Failed to create a duplicate DefaultSecurityGroup: for attribute(s) ['default_security_group.PRIMARY'] with value(s) 90adabc121ea41c8a95252bc1c7291c2 {{(pid=98277) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 02 16:40:22.335776 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_db.api [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 02 16:40:22.387940 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99a75914-47e6-4ac3-afe2-16e86966465e req-b61dd234-a73b-4a57-8323-a21551d0caeb tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0509160
Jun 02 16:40:22.396524 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5c5827c8-fa58-4d3c-b400-9f9fc9a176b2 req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3863258
Jun 02 16:40:22.419300 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:22.440055 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1aac548a-31bc-4b1e-8d8f-ce82f255f10a req-ea2a2f8f-6765-41ab-8afb-09939d50e9df tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1166518
Jun 02 16:40:22.441733 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '5e1e9de7-d161-410e-9e7e-a9f74a701739', 'network_id': '1f2f7c0d-7d36-4292-bab6-39e7de3c95ef', 'port_id': '5e1e9de7-d161-410e-9e7e-a9f74a701739', 'mac_address': 'fa:16:3e:96:8e:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0181ac68-65a5-4b9a-9995-215bf77b5c32', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:22.445405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=107eae3f-d890-4b9a-a9a4-963755265399,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:22.449082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:22.518381 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.573190 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5e1e9de7-d161-410e-9e7e-a9f74a701739 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:22.616461 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:22.627722 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.632975 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:22.754042 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9400266-5b4d-431e-8fba-c0a13d5a5df6 req-9682d6a2-3d3c-45b9-a308-cab695cacd64 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.756974 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e9400266-5b4d-431e-8fba-c0a13d5a5df6 req-9682d6a2-3d3c-45b9-a308-cab695cacd64 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1940353
Jun 02 16:40:22.818686 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9f49c0-966f-444e-a238-02d1501c0cc0 req-3fee91ec-b4cf-4d28-8a13-d75b7bc8e8dd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:22.823956 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b9f49c0-966f-444e-a238-02d1501c0cc0 req-3fee91ec-b4cf-4d28-8a13-d75b7bc8e8dd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.1478829
Jun 02 16:40:22.845905 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:22.855737 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:22.856693 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:22.930826 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['cf7356d3-b193-4ccb-a580-fe9976ab37df'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:22.942358 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e9400266-5b4d-431e-8fba-c0a13d5a5df6 req-9e6a3495-8575-4f5e-b24c-34cf8f46f3c9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1725187
Jun 02 16:40:22.967397 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b9f49c0-966f-444e-a238-02d1501c0cc0 req-997629e6-b666-4be7-8769-a39c1b205913 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1355259
Jun 02 16:40:23.076821 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['5e1e9de7-d161-410e-9e7e-a9f74a701739'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:23.120376 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5a400214-30a5-4c65-8053-2b7a2d47d26e req-b3772457-59ff-413a-ba97-6fb3617831ac service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.0966680
Jun 02 16:40:23.599991 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device b28c3bf7-7098-48bc-8c31-211ba369c5bf up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:23.743115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f8ffd4-5fa2-4f6a-9c77-9acb7b83c014 req-9dd26e09-eb52-4860-b456-52dd5954e7d6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:23.744947 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-06f8ffd4-5fa2-4f6a-9c77-9acb7b83c014 req-9dd26e09-eb52-4860-b456-52dd5954e7d6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 945 time: 0.1121156
Jun 02 16:40:23.782798 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port b28c3bf7-7098-48bc-8c31-211ba369c5bf completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:23.789105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port b28c3bf7-7098-48bc-8c31-211ba369c5bf triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:23.790166 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:23.811050 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-06f8ffd4-5fa2-4f6a-9c77-9acb7b83c014 req-5db2f023-e7db-4eca-9fb3-56e198d87fd8 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0542920
Jun 02 16:40:23.847496 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324384ee-9c27-4e77-ac1f-0c7439e85389 req-bb6ac546-d788-4adc-99f9-5f6023e2d62d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:23.856692 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-324384ee-9c27-4e77-ac1f-0c7439e85389 req-bb6ac546-d788-4adc-99f9-5f6023e2d62d tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.1351976
Jun 02 16:40:23.902562 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-324384ee-9c27-4e77-ac1f-0c7439e85389 req-2ce64077-2c11-4adf-8faa-a03d4b8712c3 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442247
Jun 02 16:40:23.943713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:24.018303 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:24.019772 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc9c3964-9206-4570-870d-511dc699a4b3" -d '{"events": [{"server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "name": "network-vif-plugged", "status": "completed", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:24.032373 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:24.039971 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:24.042267 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:24.225957 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:24.231070 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:24.315761 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b99d46-4232-4211-8160-37db8c6dedf1 req-09cdd21f-acc9-43e5-bf3f-5ee559dfc4b5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:24.319285 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-58b99d46-4232-4211-8160-37db8c6dedf1 req-09cdd21f-acc9-43e5-bf3f-5ee559dfc4b5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.2138410
Jun 02 16:40:24.364674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a222b5-5b5a-4f1f-a22a-3b033e0c310b req-d72ac694-1890-4f7f-bc87-3f0915d28afb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:24.373904 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-80a222b5-5b5a-4f1f-a22a-3b033e0c310b req-d72ac694-1890-4f7f-bc87-3f0915d28afb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.1679678
Jun 02 16:40:24.441134 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-80a222b5-5b5a-4f1f-a22a-3b033e0c310b req-d273ed1e-0bcb-4209-aef5-90f5d5d87f16 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0621543
Jun 02 16:40:24.456122 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-58b99d46-4232-4211-8160-37db8c6dedf1 req-254c8042-af72-4c60-a0ce-e837ae8f3bb9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1278265
Jun 02 16:40:24.536963 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed0edd1b-19de-43f8-95b1-a79618a57a9c x-openstack-request-id: req-ed0edd1b-19de-43f8-95b1-a79618a57a9c {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:24.537265 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "name": "network-vif-plugged", "status": "completed", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:24.537521 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ed0edd1b-19de-43f8-95b1-a79618a57a9c {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:24.537944 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf', 'code': 200}
Jun 02 16:40:24.849371 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68911874-0112-4dfb-9306-001e070e201a req-db2591cb-f0f9-438b-8f0a-36a35b0f6eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:24.852582 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-68911874-0112-4dfb-9306-001e070e201a req-db2591cb-f0f9-438b-8f0a-36a35b0f6eb0 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.1273997
Jun 02 16:40:24.916108 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-68911874-0112-4dfb-9306-001e070e201a req-3aaba7a8-07c8-479c-a8ed-52797d7d5447 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543003
Jun 02 16:40:25.113873 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576ce971-82e1-4c10-8cae-a255856a14f1 req-a8250608-9f2b-420b-a152-7359ae19514c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:25.123319 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-576ce971-82e1-4c10-8cae-a255856a14f1 req-a8250608-9f2b-420b-a152-7359ae19514c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 945 time: 0.1329787
Jun 02 16:40:25.196847 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-576ce971-82e1-4c10-8cae-a255856a14f1 req-3166d22b-a53d-4f49-acfd-d443edaeee3b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722370
Jun 02 16:40:25.219532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa70c35f-177a-45bb-9965-7d2a8dab2dd0 req-c0af81df-afa8-4199-8796-d0a135d0531e tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:25.229910 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-aa70c35f-177a-45bb-9965-7d2a8dab2dd0 req-c0af81df-afa8-4199-8796-d0a135d0531e tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.1377523
Jun 02 16:40:25.283234 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-aa70c35f-177a-45bb-9965-7d2a8dab2dd0 req-7e4586f9-a252-4670-a742-fa6e97943c09 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514827
Jun 02 16:40:25.807503 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-f6b91f63-4651-44da-9028-87d5326b9916 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:25.827335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06d9150-84d0-482f-9b6c-22a04fe6b885 req-a1c0bbef-a1ad-4237-b57d-8552de6b54cd tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:25.830412 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b06d9150-84d0-482f-9b6c-22a04fe6b885 req-a1c0bbef-a1ad-4237-b57d-8552de6b54cd tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.2004111
Jun 02 16:40:25.901420 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6285dcb7-d9c1-49c8-8eac-5bb5b30199e0 req-e1753820-6acc-481d-962f-6f978c1e9e22 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:25.906134 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6285dcb7-d9c1-49c8-8eac-5bb5b30199e0 req-e1753820-6acc-481d-962f-6f978c1e9e22 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.2060628
Jun 02 16:40:25.947965 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b06d9150-84d0-482f-9b6c-22a04fe6b885 req-dfdbd6db-1a3e-4268-a832-d7f7eed3d7cc tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1073077
Jun 02 16:40:25.974192 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6285dcb7-d9c1-49c8-8eac-5bb5b30199e0 req-232f0496-16d2-4be4-a76e-04d59d58b66d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0586333
Jun 02 16:40:26.482095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca907fa7-a7e2-4f51-8e10-765fb3a723de req-cb77c69b-eeaa-4d66-b2f4-547c8ea4e678 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:26.483660 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ca907fa7-a7e2-4f51-8e10-765fb3a723de req-cb77c69b-eeaa-4d66-b2f4-547c8ea4e678 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 945 time: 0.1092522
Jun 02 16:40:26.513061 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:26.553592 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ca907fa7-a7e2-4f51-8e10-765fb3a723de req-a26a10bd-18c4-462b-8666-8a7ba3653106 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590396
Jun 02 16:40:26.642264 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port cf7356d3-b193-4ccb-a580-fe9976ab37df completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:26.648366 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port cf7356d3-b193-4ccb-a580-fe9976ab37df triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:26.648875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:26.806934 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:26.861797 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:26.865991 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-107ffc0e-d685-43d0-928e-002af96bf7b5" -d '{"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:26.880295 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:26.887022 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:26.888843 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 5e1e9de7-d161-410e-9e7e-a9f74a701739 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:26.938885 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-aab67832-69f7-4bd8-a1d3-4878a8fc0a34 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:26.977947 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29daba3b-5cf6-4106-821e-05b8c22ac783 x-openstack-request-id: req-29daba3b-5cf6-4106-821e-05b8c22ac783 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:26.978240 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:26.978898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-29daba3b-5cf6-4106-821e-05b8c22ac783 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:26.979308 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'code': 200}
Jun 02 16:40:27.042305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:27.046418 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:27.053239 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 5e1e9de7-d161-410e-9e7e-a9f74a701739 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:27.062253 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 5e1e9de7-d161-410e-9e7e-a9f74a701739 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:27.062850 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:27.232252 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:27.283683 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac875dc-5945-43c2-b884-e96869336dc0 req-6954148d-1f56-4484-ab0c-9da83b3c2e31 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:27.285245 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9ac875dc-5945-43c2-b884-e96869336dc0 req-6954148d-1f56-4484-ab0c-9da83b3c2e31 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1027875
Jun 02 16:40:27.299531 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:27.305229 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:27.307496 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:27.354211 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9ac875dc-5945-43c2-b884-e96869336dc0 req-8e5894b5-f186-4d5e-b95c-eee86428f685 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0527399
Jun 02 16:40:27.403628 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:27.407598 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:27.761472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74f47d7-c116-40b7-bd12-5490b146b77c req-800a90eb-4495-43d1-8324-b8a83fda0c2e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:27.763082 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c74f47d7-c116-40b7-bd12-5490b146b77c req-800a90eb-4495-43d1-8324-b8a83fda0c2e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0830379
Jun 02 16:40:27.812208 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c74f47d7-c116-40b7-bd12-5490b146b77c req-e3a1855f-c5eb-4fe2-b111-a270d6fc4d87 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428069
Jun 02 16:40:28.465512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c5381969-4576-4d4b-af25-24db7748a28d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:28.550782 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611f8355-a309-46fc-945b-adb595929320 req-305de74c-3665-4f00-99dc-a6f3ae088745 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:28.552376 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-611f8355-a309-46fc-945b-adb595929320 req-305de74c-3665-4f00-99dc-a6f3ae088745 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.0913029
Jun 02 16:40:28.603162 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-611f8355-a309-46fc-945b-adb595929320 req-aa886e2f-3a83-4afd-a62d-312f35402df8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444276
Jun 02 16:40:28.750035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:28.893167 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e4adc6-f2d2-4e6b-aca5-ffd99b3aba18 req-8142dfaf-ccd4-4022-8968-d972899aa5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:28.895343 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c3e4adc6-f2d2-4e6b-aca5-ffd99b3aba18 req-8142dfaf-ccd4-4022-8968-d972899aa5e1 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1098 time: 0.0787399
Jun 02 16:40:28.980583 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:28.983103 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8cfb719-dfa3-4254-a038-c1649cbbdb99" -d '{"events": [{"server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:28.998957 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c3e4adc6-f2d2-4e6b-aca5-ffd99b3aba18 req-f2781510-0bc6-4a34-ac3c-84232fcafb6b service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0788460
Jun 02 16:40:29.033773 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c672e08-8da4-4c05-bddd-0b766844f10c x-openstack-request-id: req-0c672e08-8da4-4c05-bddd-0b766844f10c {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:29.034348 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:29.034789 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0c672e08-8da4-4c05-bddd-0b766844f10c {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:29.035362 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739', 'code': 200}
Jun 02 16:40:29.045066 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e615a092-6132-4621-8abd-1857b8364f59 req-ba258f7a-b850-473f-966e-65df5826fd6e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:29.046563 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e615a092-6132-4621-8abd-1857b8364f59 req-ba258f7a-b850-473f-966e-65df5826fd6e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1141624
Jun 02 16:40:29.096760 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e615a092-6132-4621-8abd-1857b8364f59 req-843c4b58-cf3f-421f-b617-a2aff3c4b64e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425606
Jun 02 16:40:29.414714 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1659d0e9-5b54-4458-a019-8e7587a076cf req-e20f762d-109c-418a-a4cb-d0f8f44c5174 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:29.416822 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1659d0e9-5b54-4458-a019-8e7587a076cf req-e20f762d-109c-418a-a4cb-d0f8f44c5174 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1099 time: 0.0981550
Jun 02 16:40:29.476092 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1659d0e9-5b54-4458-a019-8e7587a076cf req-56b567dd-351b-4775-bb90-b796f1cfa897 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425456
Jun 02 16:40:29.813287 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e66605-1ac2-4a87-843d-b174d917341f req-f7bdfa71-aac3-44b9-9a84-c53e65e0f8d0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:29.815042 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-13e66605-1ac2-4a87-843d-b174d917341f req-f7bdfa71-aac3-44b9-9a84-c53e65e0f8d0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.0848463
Jun 02 16:40:29.865536 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-13e66605-1ac2-4a87-843d-b174d917341f req-4b288818-0b9c-4361-a0a8-9c06c5170023 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441859
Jun 02 16:40:30.179919 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:30.333154 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98188045-514e-4afd-8cb2-9995fcd52f79 req-ba3b5737-1c24-4dab-bc14-4eb0105b6e03 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:30.335457 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-98188045-514e-4afd-8cb2-9995fcd52f79 req-ba3b5737-1c24-4dab-bc14-4eb0105b6e03 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1042020
Jun 02 16:40:30.423887 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-98188045-514e-4afd-8cb2-9995fcd52f79 req-5f94ac5f-b6ca-4588-9d13-d82595d31b15 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0783284
Jun 02 16:40:31.150892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44569aa8-1e72-4912-bbf6-42b83ca1c6c0 req-87f2191d-dedf-4bf1-ace6-0e9922f33f41 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:31.153407 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-44569aa8-1e72-4912-bbf6-42b83ca1c6c0 req-87f2191d-dedf-4bf1-ace6-0e9922f33f41 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1596270
Jun 02 16:40:31.208313 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-44569aa8-1e72-4912-bbf6-42b83ca1c6c0 req-9bce40f0-1d5c-43b6-b674-23c8076afb23 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467699
Jun 02 16:40:31.461989 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7a3288-4548-4518-b832-040891f43928 req-923a69a2-2b8a-4b6d-ad01-287e39295a3e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:31.465321 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8c7a3288-4548-4518-b832-040891f43928 req-923a69a2-2b8a-4b6d-ad01-287e39295a3e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1229300
Jun 02 16:40:31.483815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49342) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:31.492678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'floatingip': {'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:31.591736 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:31.791066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3fe642-1c47-4310-b8c0-828a10cd0a27 req-2afef1f0-aac1-457a-9ada-64427cd7921e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:31.793757 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3d3fe642-1c47-4310-b8c0-828a10cd0a27 req-2afef1f0-aac1-457a-9ada-64427cd7921e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1550295
Jun 02 16:40:31.846312 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:31.876460 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3d3fe642-1c47-4310-b8c0-828a10cd0a27 req-d223f29d-7f91-4b46-9466-4171d59fff4a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0755658
Jun 02 16:40:32.546402 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0094088f-abc9-4d10-8f6e-162e6ffc9f45 req-2b34d230-913d-4144-a69e-9d08af03e11a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:32.548796 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0094088f-abc9-4d10-8f6e-162e6ffc9f45 req-2b34d230-913d-4144-a69e-9d08af03e11a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1296916
Jun 02 16:40:32.606341 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0094088f-abc9-4d10-8f6e-162e6ffc9f45 req-05174470-c488-445d-987f-a3c811352b4b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0472949
Jun 02 16:40:32.985658 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:32.995462 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:33.214469 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Floating IP 332e7e03-e21b-4eb4-b91d-8e21b7e8a718 associated. External IP: 172.27.0.132, port: cf7356d3-b193-4ccb-a580-fe9976ab37df.
Jun 02 16:40:33.472571 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49400) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:33.615521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:33.632041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:33.638778 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Usage tracker for resource:security_group_rule and tenant:7f77a34c06af4cccbf1be206c5cc8bc9 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:33.643755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:33.655360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:33.687549 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:40:33.735510 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:33.856146 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:33.864063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:33.890213 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-eb6bb0e0-7ea9-42d7-b44b-be7adcbbbfd7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:33.917101 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7f77a34c06af4cccbf1be206c5cc8bc9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4433842
Jun 02 16:40:33.920929 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49408) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:33.939819 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3245c120-fba8-4ad3-94c2-b5255b01df93,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:33.943778 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:34.002500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.068887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:40:34.093861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.104415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.107776 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:40:34.133697 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:40:34.135001 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7ccc78e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:34.190060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.207426 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:34.232571 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3245c120-fba8-4ad3-94c2-b5255b01df93,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:34.244314 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:34.252049 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.257760 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3245c120-fba8-4ad3-94c2-b5255b01df93 HTTP/1.1" status: 204  len: 168 time: 0.3356969
Jun 02 16:40:34.334884 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3928dc43-e23b-4fb5-9b91-d1a23ad49e60 req-fa4b54db-c679-4e48-9198-520d00f3cd99 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:34.336472 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3928dc43-e23b-4fb5-9b91-d1a23ad49e60 req-fa4b54db-c679-4e48-9198-520d00f3cd99 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.4167123
Jun 02 16:40:34.341971 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-747352b0-6a3a-450f-9f8f-05d374ceca39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "PUT /v2.0/floatingips/332e7e03-e21b-4eb4-b91d-8e21b7e8a718 HTTP/1.1" status: 200  len: 991 time: 2.8528180
Jun 02 16:40:34.341971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:34.341971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f7a351a-9e6f-4a7b-a10e-630607c801eb" -d '{"events": [{"name": "network-changed", "server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:34.401088 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3928dc43-e23b-4fb5-9b91-d1a23ad49e60 req-0362f5c6-012d-47c0-8987-b69e9d899029 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445776
Jun 02 16:40:34.443596 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:40:34.481085 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7cfbb0e-e02a-405c-b676-5dde507da674 x-openstack-request-id: req-c7cfbb0e-e02a-405c-b676-5dde507da674 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:34.481415 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:34.481866 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c7cfbb0e-e02a-405c-b676-5dde507da674 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:34.482290 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'status': 'completed', 'code': 200}
Jun 02 16:40:34.769415 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49426) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:34.787066 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.803011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:34.807498 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Usage tracker for resource:security_group_rule and tenant:b5eada8613ee43ff9ea68741c1e6b6c2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:34.810957 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:34.818348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:34.896238 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7ccc78e0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '332e7e03-e21b-4eb4-b91d-8e21b7e8a718', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.132', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 123, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:40:00Z', 'updated_at': '2021-06-02T16:40:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:34.900808 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:40:34.915246 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:40:34.916256 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7ccc78e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:34.929399 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.935731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:34.951043 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0709236b-d1b3-41a3-8ead-25272e52876f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:35.025476 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b5eada8613ee43ff9ea68741c1e6b6c2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2543821
Jun 02 16:40:35.027903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49430) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:35.031188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a1dae67-1743-4614-a16a-38808f82ae3e,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:35.036413 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:35.123679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:35.183199 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:35.216263 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:40:35.369014 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-b15d1a8a-528c-43ce-8db3-2a8823f854c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:35.370565 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-b15d1a8a-528c-43ce-8db3-2a8823f854c5 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1098 time: 0.1584258
Jun 02 16:40:35.405566 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:35.420570 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-29960a94-b9a2-43fc-83ce-cc23b16710ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:35.423364 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-29960a94-b9a2-43fc-83ce-cc23b16710ec service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1099 time: 0.2145114
Jun 02 16:40:35.423719 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e858532e-43bb-4f36-aa13-0b200d9a327c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:35.488419 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a1dae67-1743-4614-a16a-38808f82ae3e,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:35.496954 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:35.502493 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:35.504057 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1a1dae67-1743-4614-a16a-38808f82ae3e HTTP/1.1" status: 204  len: 168 time: 0.4745688
Jun 02 16:40:35.658268 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-073881d3-c8fe-46f0-aa01-ce65dc5c9e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:35.660017 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-073881d3-c8fe-46f0-aa01-ce65dc5c9e8c service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.2742960
Jun 02 16:40:35.732835 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-020d63ca-a954-4edc-ac73-377262283e42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:35.735942 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-020d63ca-a954-4edc-ac73-377262283e42 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.2928998
Jun 02 16:40:35.890313 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-600d4b74-69bc-4da2-bb2e-866a26150b72 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 200  len: 999 time: 0.2182143
Jun 02 16:40:35.979338 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-08706c3b-795d-4a66-a7ed-79c4186d8ece service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739 HTTP/1.1" status: 200  len: 217 time: 0.1339979
Jun 02 16:40:36.002925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-dc1f6872-60ce-46b4-905d-98dca6ed9246 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:36.005134 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-dc1f6872-60ce-46b4-905d-98dca6ed9246 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.1071899
Jun 02 16:40:36.053293 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7ccc78e0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '332e7e03-e21b-4eb4-b91d-8e21b7e8a718', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.132', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 123, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:40:00Z', 'updated_at': '2021-06-02T16:40:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:36.066017 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98820985-ee00-46ab-9bf3-faf3acbae43c None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '332e7e03-e21b-4eb4-b91d-8e21b7e8a718', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.132', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 123, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:40:00Z', 'updated_at': '2021-06-02T16:40:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:40:36.089518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532bfa3d-4ed4-4913-9520-b275a22a0430 req-532f311c-978c-4fbb-827c-22389d2543a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:36.091226 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-532bfa3d-4ed4-4913-9520-b275a22a0430 req-532f311c-978c-4fbb-827c-22389d2543a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.3540163
Jun 02 16:40:36.126324 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-e000569b-a8ae-4420-91ae-f744b4e9ea3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:36.128038 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-e000569b-a8ae-4420-91ae-f744b4e9ea3c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.1335056
Jun 02 16:40:36.156880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-a5daca34-4e41-4b08-a1d9-65522787b759 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:36.158420 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-a5daca34-4e41-4b08-a1d9-65522787b759 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1299913
Jun 02 16:40:36.215747 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-532bfa3d-4ed4-4913-9520-b275a22a0430 req-5a20a96d-3db0-47e8-a959-585d2f661e33 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1170762
Jun 02 16:40:36.219862 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-4846630d-80f7-4496-9010-fa78cbf2fa78 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0702126
Jun 02 16:40:36.495310 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-13abfb89-f631-4e60-a725-d991d50c29c9 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3171899
Jun 02 16:40:36.518006 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-ac51af6d-fcb1-4c7b-9e18-14bb536cb0d1 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2828038
Jun 02 16:40:36.598645 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48a41ecc-1e0c-4580-b809-f2bfbbe547b1 None None] New status for floating IP 332e7e03-e21b-4eb4-b91d-8e21b7e8a718: ACTIVE {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:40:36.855683 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f7a351a-9e6f-4a7b-a10e-630607c801eb req-f0065d06-b4c9-48e3-9d3e-bbdb17ad9083 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3344979
Jun 02 16:40:37.007842 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49486) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:37.037650 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-885f3c0e-5a75-44e8-be47-9e14d004bddf req-a0530e6d-b51b-4739-b3df-608c75a33c86 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5097508
Jun 02 16:40:37.510928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:37.544697 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:37.558732 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Usage tracker for resource:security_group_rule and tenant:d4c096660e2c4ca8abf60d6e27a30be4 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:37.559201 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe29f971-9eef-4d65-a0d0-48fdac941258 req-f57685c7-8a5f-4f4a-aea3-f40bd43e7003 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:37.562984 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe29f971-9eef-4d65-a0d0-48fdac941258 req-f57685c7-8a5f-4f4a-aea3-f40bd43e7003 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1939361
Jun 02 16:40:37.564010 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:37.575513 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:37.695868 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe29f971-9eef-4d65-a0d0-48fdac941258 req-b3566d72-f1a3-4cdc-a2f6-c038c3bf18f1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1111791
Jun 02 16:40:37.738221 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:37.745422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:37.761132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2f0e3d2d-f1a2-48f2-a940-38073a174cf1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:37.841803 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d4c096660e2c4ca8abf60d6e27a30be4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8321252
Jun 02 16:40:37.844355 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49516) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:37.846985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1b4b146-9982-4353-827e-9758f919e2e1,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:37.869230 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.869959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.871458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.871458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.871804 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.872115 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.872639 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.873199 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.874128 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.875135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.875867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.876355 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:37.885202 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:37.966554 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:37.999679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:38.077082 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:38.083047 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-060dc37e-6e0f-4a5d-ac79-a8e2351e4d1d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:38.094216 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1b4b146-9982-4353-827e-9758f919e2e1,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:38.106613 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.107011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.107295 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.107629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.107957 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.108284 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.108605 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.108938 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.109363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.109730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.110055 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.110372 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:38.113980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:38.115503 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b1b4b146-9982-4353-827e-9758f919e2e1 HTTP/1.1" status: 204  len: 168 time: 0.2699239
Jun 02 16:40:38.116785 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:38.697137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49556) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:38.724732 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:38.755705 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:38.761677 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Usage tracker for resource:security_group_rule and tenant:68649a2b3b9249a1ae59aa746b3e8037 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:38.766119 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:38.777004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:39.030944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.053988 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.098915 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:39.152122 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=68649a2b3b9249a1ae59aa746b3e8037&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4523659
Jun 02 16:40:39.155648 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49574) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:39.193843 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b885061-4037-4ae6-8a43-83ce203a3aa7,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:39.204427 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:39.222323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da528ba3-ddd4-47ec-9e2e-f420f861531c req-c6b660eb-e81f-40a8-858a-23fd974e1d30 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:39.225039 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-da528ba3-ddd4-47ec-9e2e-f420f861531c req-c6b660eb-e81f-40a8-858a-23fd974e1d30 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.3057227
Jun 02 16:40:39.266586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.300146 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.331532 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-da528ba3-ddd4-47ec-9e2e-f420f861531c req-52ed067e-2dc6-4f4e-97fc-05f285fb11b7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0937731
Jun 02 16:40:39.402588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.407364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:39.431629 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b885061-4037-4ae6-8a43-83ce203a3aa7,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:39.436969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:39.454704 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:39.456607 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6b885061-4037-4ae6-8a43-83ce203a3aa7 HTTP/1.1" status: 204  len: 168 time: 0.2991097
Jun 02 16:40:40.113795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49596) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:40.135698 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.154584 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:40.159096 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Usage tracker for resource:security_group_rule and tenant:61146c6158704cc28c60d60e42d86ab8 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:40.162696 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:40.169695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:40.291402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.298631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.307627 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:40.362719 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=61146c6158704cc28c60d60e42d86ab8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2471118
Jun 02 16:40:40.363680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d28878fb-4eb0-4460-b8d7-b36ca0986708,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:40.367332 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49614) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:40.369826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:40.506338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.541332 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.615004 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.621049 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:40.635957 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d28878fb-4eb0-4460-b8d7-b36ca0986708,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:40.645406 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:40.646698 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:40.648101 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d28878fb-4eb0-4460-b8d7-b36ca0986708 HTTP/1.1" status: 204  len: 168 time: 0.2609034
Jun 02 16:40:40.700480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbf12c1c-9413-4767-ac6a-d001b9b09c3b req-296ff201-b24b-4889-b188-b471ea2150dd tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:40.702104 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bbf12c1c-9413-4767-ac6a-d001b9b09c3b req-296ff201-b24b-4889-b188-b471ea2150dd tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1549335
Jun 02 16:40:40.757979 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bbf12c1c-9413-4767-ac6a-d001b9b09c3b req-4db88e27-030c-4bac-8c35-0fe560992201 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481851
Jun 02 16:40:42.004142 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1c1249-841f-4f90-a22c-fdc0ed6d7e1e req-20cb4c02-a7b9-4a14-8566-3c7d82ef634b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:42.006699 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4b1c1249-841f-4f90-a22c-fdc0ed6d7e1e req-20cb4c02-a7b9-4a14-8566-3c7d82ef634b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0978935
Jun 02 16:40:42.072278 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4b1c1249-841f-4f90-a22c-fdc0ed6d7e1e req-820cd66d-99fa-47d6-9740-7ec413bfd7e5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0567160
Jun 02 16:40:42.683356 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49712) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:42.934432 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:42.951924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:42.956143 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Usage tracker for resource:security_group_rule and tenant:91d9a8c6bc3e43489790b909d75a4d41 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:42.959906 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:42.967580 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:43.205717 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.216913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.237974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:43.359905 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73b54c49-949a-4759-b002-bdd8ef218a20,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:43.364211 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:43.373912 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=91d9a8c6bc3e43489790b909d75a4d41&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6885226
Jun 02 16:40:43.376120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49746) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:43.464500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49750) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:43.475129 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e038da06-8b4b-489f-a370-c0e03ce5c955 req-aa5fb203-7d8e-47c4-a736-18468d543272 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:43.489335 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e038da06-8b4b-489f-a370-c0e03ce5c955 req-aa5fb203-7d8e-47c4-a736-18468d543272 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1881149
Jun 02 16:40:43.494241 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.537018 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.569102 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e038da06-8b4b-489f-a370-c0e03ce5c955 req-fa6309db-3f81-43fa-8929-80d6ab8fbcfd tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0786035
Jun 02 16:40:43.650082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.655132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:43.691856 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73b54c49-949a-4759-b002-bdd8ef218a20,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:43.707980 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:43.709055 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.717021 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/73b54c49-949a-4759-b002-bdd8ef218a20 HTTP/1.1" status: 204  len: 168 time: 0.3383582
Jun 02 16:40:43.778726 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:43.800854 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:43.813006 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Usage tracker for resource:security_group_rule and tenant:86c2281d6a6e4a44b0db3052cba2a56a is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:43.817850 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:43.831431 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:44.101272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.118124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.131866 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4a9f4982-9cb6-4470-a6ed-da90c05035f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:44.160848 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49786) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:44.179396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.186586 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=86c2281d6a6e4a44b0db3052cba2a56a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7194889
Jun 02 16:40:44.192139 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49788) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:44.204374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:44.209276 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Usage tracker for resource:security_group_rule and tenant:6059ca46664f43728a8b7d7851331bfd is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:44.213111 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:44.219823 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:44.231674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eaf6ca7e-3935-45b8-823a-bb5517940739,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:44.243564 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-e8b3bfc2-cd31-4dc4-a4e3-2d6cadcf8dfa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:44.250384 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-e8b3bfc2-cd31-4dc4-a4e3-2d6cadcf8dfa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.3417287
Jun 02 16:40:44.252383 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:44.275587 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-936d8ddc-fa4b-4f90-8fba-6b7e9052cca4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/quotas/a3af7d82fba84269a3596d85213ae5e2 HTTP/1.1" status: 200  len: 375 time: 0.0242434
Jun 02 16:40:44.339934 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.346847 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.361894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.381801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:44.396508 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.448655 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6059ca46664f43728a8b7d7851331bfd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2866802
Jun 02 16:40:44.449705 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=260bf6b6-b6c2-4029-bab8-5dbad4053ef5,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:44.453458 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:44.456413 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-9f0d742f-f026-4d49-8532-9d63f8426d1f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1798687
Jun 02 16:40:44.456669 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49800) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:44.537642 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.573203 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.649592 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.651278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.660006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:44.661183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:44.684910 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaf6ca7e-3935-45b8-823a-bb5517940739,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:44.690293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:44.700292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=260bf6b6-b6c2-4029-bab8-5dbad4053ef5,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:44.706895 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:44.711948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.713351 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/eaf6ca7e-3935-45b8-823a-bb5517940739 HTTP/1.1" status: 204  len: 168 time: 0.5202689
Jun 02 16:40:44.722970 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-f7e67c37-7075-4b6b-8ab7-e6b923df8d4a service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2653728
Jun 02 16:40:44.825479 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:44.830819 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/260bf6b6-b6c2-4029-bab8-5dbad4053ef5 HTTP/1.1" status: 204  len: 168 time: 0.3692651
Jun 02 16:40:44.881486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01db15a3-41b5-4c62-994e-cbfae3a2d4fc req-482ad18b-b879-482f-940f-6229bb69334a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:44.883232 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-01db15a3-41b5-4c62-994e-cbfae3a2d4fc req-482ad18b-b879-482f-940f-6229bb69334a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1060808
Jun 02 16:40:44.932612 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-1fc56ad3-53f2-4b54-9eb1-01647ed97941 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2084732
Jun 02 16:40:44.948895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49812) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:44.952105 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-01db15a3-41b5-4c62-994e-cbfae3a2d4fc req-126f5d69-e94d-4906-b757-9db18452f63e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0621400
Jun 02 16:40:45.169709 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dc1df779-3b50-4dad-a1f4-fae5e1a2846b req-0b6ee26f-4b97-4466-9fe5-2a7fd927182b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 210 time: 0.0545917
Jun 02 16:40:45.436646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.486412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:45.495039 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Usage tracker for resource:security_group_rule and tenant:6aebf49d5fbc4663be74fcb117845e9a is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:45.503399 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:45.522605 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49842) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:45.528677 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:45.534080 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:40:45.558283 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.603680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:45.616038 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Usage tracker for resource:security_group_rule and tenant:d0691fdbe2924d5eb0a877e834522a4a is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:45.624246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:45.641018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:45.675718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.681673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.716445 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b5bc3d1-4504-4d45-bc6b-16e4fe2e3a68 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:45.727286 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6aebf49d5fbc4663be74fcb117845e9a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7773149
Jun 02 16:40:45.731317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49846) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:45.824349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.830272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.842519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:45.845183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=889c436f-47d5-4654-ab18-c29ff49a59fc,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:45.853724 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:45.883618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.893731 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d0691fdbe2924d5eb0a877e834522a4a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3670163
Jun 02 16:40:45.894725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 49854) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:45.927666 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=911cf36c-9e50-4df8-ae89-a8c7ab2f2521,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:45.927886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:45.943365 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:46.015987 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.026277 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-09614427-9bd5-488d-94fd-a601eb2c7078 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:46.064165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.066888 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=889c436f-47d5-4654-ab18-c29ff49a59fc,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:46.080777 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:46.109010 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.110588 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.112802 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/889c436f-47d5-4654-ab18-c29ff49a59fc HTTP/1.1" status: 204  len: 168 time: 0.3802547
Jun 02 16:40:46.222197 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.234342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-048105f9-a190-40a0-b624-5927f02bfb6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:46.370731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=911cf36c-9e50-4df8-ae89-a8c7ab2f2521,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:46.380492 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:46.420665 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-afb8c24d-723b-4331-8141-5e3216ec1562 req-b3fc3663-6f32-46aa-becd-6afb1f58afd9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 210 time: 0.0803149
Jun 02 16:40:46.430253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:46.438361 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/911cf36c-9e50-4df8-ae89-a8c7ab2f2521 HTTP/1.1" status: 204  len: 168 time: 0.5386457
Jun 02 16:40:46.518661 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3b79ea-cf91-431f-be0c-11f3cfecb28f req-d57044b0-275a-4c62-9b40-ac966d8e7bac tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:46.521136 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cd3b79ea-cf91-431f-be0c-11f3cfecb28f req-d57044b0-275a-4c62-9b40-ac966d8e7bac tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2891562
Jun 02 16:40:46.665052 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cd3b79ea-cf91-431f-be0c-11f3cfecb28f req-56dc4d56-548b-48ee-9c78-1e1a4c88011d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1341362
Jun 02 16:40:47.115068 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-d6e62c92-b7ee-45f8-a3a6-ddb11a6ae530 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:47.117945 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-d6e62c92-b7ee-45f8-a3a6-ddb11a6ae530 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.3429110
Jun 02 16:40:47.135046 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49894) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:47.157427 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Request body: {'port': {'device_id': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'admin_state_up': True, 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:47.206387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.227174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:47.234693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Usage tracker for resource:security_group_rule and tenant:caf4953f600d45edb608a31e300dc8c8 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:47.239939 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:47.259033 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:47.405493 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.410829 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.413500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:47.425460 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:47.427033 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:47.437500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:40:47.441554 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.479725 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=caf4953f600d45edb608a31e300dc8c8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3421378
Jun 02 16:40:47.490716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49908) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:47.503768 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f67a50f-8519-49d7-b7e7-30f603c6e09e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:47.543834 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:47.720002 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Allocated IP 172.20.0.6 (87543dfa-9cef-40b2-b537-1f95fcf2b066/409c7043-b3b6-42f7-90b5-f7db5d717e70/aa2c51f5-ce26-4924-b07d-2fd35ef89adb) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:40:47.748997 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-559b4b04-efa9-4e7a-b7fc-17db86f9b667 req-64d4fce7-885a-4d1a-b868-aa906fe352fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 210 time: 0.1105933
Jun 02 16:40:47.786481 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.834120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.941399 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:47.952431 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:48.008307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.015202 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f67a50f-8519-49d7-b7e7-30f603c6e09e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:48.020600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:48.023917 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.025265 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2f67a50f-8519-49d7-b7e7-30f603c6e09e HTTP/1.1" status: 204  len: 168 time: 0.5275848
Jun 02 16:40:48.064962 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dfe7c1d-5c0b-4747-97a1-5b9fb45d93ce req-9047098a-36ab-464b-b098-dbc36a79c636 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:48.066711 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3dfe7c1d-5c0b-4747-97a1-5b9fb45d93ce req-9047098a-36ab-464b-b098-dbc36a79c636 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0998554
Jun 02 16:40:48.069305 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.081554 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:48.085964 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:48.139515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:40:48.143072 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:40:48.156484 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:40:48.162349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:48.162995 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.179278 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3dfe7c1d-5c0b-4747-97a1-5b9fb45d93ce req-e0d72da9-4cf1-46e3-9c75-53b1ce3d7f5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1042161
Jun 02 16:40:48.197794 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event updated for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:48.201361 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:48.207620 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0651810
Jun 02 16:40:48.229556 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Request body: {'port': {'device_id': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:40:48.424440 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.681078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49954) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:48.803540 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Deleting subnet 642fb54f-8889-4243-b7e2-ba5e1dc643e6 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:40:48.809231 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.915209 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:48.931552 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.257909 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa2c51f5-ce26-4924-b07d-2fd35ef89adb {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:49.271446 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.311050 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Transition to ACTIVE for port object aa2c51f5-ce26-4924-b07d-2fd35ef89adb will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:40:49.319626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.326976 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b4237034-6862-4bb9-8c1a-6f3e8f07f4c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:49.636900 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.643049 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1629be4a-881a-4754-9e1c-7ce91592d408 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:49.685441 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f9a1f4-460f-4c20-8801-44e7646ad58f req-ef787e00-3cf2-4e56-92d4-2e689d4a69c2 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:49.688171 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93f9a1f4-460f-4c20-8801-44e7646ad58f req-ef787e00-3cf2-4e56-92d4-2e689d4a69c2 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1669486
Jun 02 16:40:49.696565 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=642fb54f-8889-4243-b7e2-ba5e1dc643e6,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:49.701103 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.705239 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:49.726083 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c578a041-5c91-49db-bfe7-22a4d76f1075 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/642fb54f-8889-4243-b7e2-ba5e1dc643e6 HTTP/1.1" status: 204  len: 168 time: 1.0434206
Jun 02 16:40:49.730368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 49990) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:49.744222 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Pushing event updated for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:49.753867 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:49.777043 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Attempting to bind port aa2c51f5-ce26-4924-b07d-2fd35ef89adb on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:40:49.777408 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Attempting to bind port aa2c51f5-ce26-4924-b07d-2fd35ef89adb by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:40:49.777842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Attempting to bind port aa2c51f5-ce26-4924-b07d-2fd35ef89adb on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:49.786260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Port aa2c51f5-ce26-4924-b07d-2fd35ef89adb on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:40:49.786641 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Attempting to bind port aa2c51f5-ce26-4924-b07d-2fd35ef89adb on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:40:49.796105 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:40:49.796526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Checking segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:40:49.796857 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Bound using segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:40:49.797304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Bound port: aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:40:49.797676 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.807879 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93f9a1f4-460f-4c20-8801-44e7646ad58f req-0ac60e54-ffbf-46fe-ad3b-e04fd30dd602 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1080477
Jun 02 16:40:49.825135 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e509289-c96b-4db7-aa9f-2e2e13d66b61 req-f7c4026c-55f1-412c-9f24-fc259384f4b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:49.825910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8e509289-c96b-4db7-aa9f-2e2e13d66b61 req-f7c4026c-55f1-412c-9f24-fc259384f4b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:49.897250 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:49.918554 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8e509289-c96b-4db7-aa9f-2e2e13d66b61 req-f7c4026c-55f1-412c-9f24-fc259384f4b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:49.925231 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8e509289-c96b-4db7-aa9f-2e2e13d66b61 req-f7c4026c-55f1-412c-9f24-fc259384f4b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 943 time: 0.4751141
Jun 02 16:40:49.968774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:40:49.973874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:40:50.002511 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8e509289-c96b-4db7-aa9f-2e2e13d66b61 req-98ad6bf8-bb28-4bc7-b809-2b1b8b15a9e9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0761566
Jun 02 16:40:50.004746 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.017285 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-261f7785-b081-4a91-ad20-e8b9498cb2e5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:50.086773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:50.087390 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.089442 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] 10.222.0.20 "PUT /v2.0/ports/aa2c51f5-ce26-4924-b07d-2fd35ef89adb HTTP/1.1" status: 200  len: 1093 time: 1.8643932
Jun 02 16:40:50.089737 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:50.092265 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81169720-07da-4ee8-a223-1d88a2f01150" -d '{"events": [{"name": "network-changed", "server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:50.205839 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.225418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f9b7bb464c0>> segment before_delete 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.225922 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f9b7bb464c0>> subnet precommit_delete_associations 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.226869 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> segment_host_mapping after_create 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.227265 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> port after_create 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.227627 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> port after_delete 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.228027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> port after_update 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.228741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> segment after_delete 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.229111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> subnet after_create 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.229423 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> subnet after_delete 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.229760 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b7cc18520>> subnet after_update 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.278803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e857fe9-bd37-43f4-84d0-db7f5eabb989 x-openstack-request-id: req-6e857fe9-bd37-43f4-84d0-db7f5eabb989 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:50.279789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:50.279789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-6e857fe9-bd37-43f4-84d0-db7f5eabb989 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:50.279971 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', 'status': 'completed', 'code': 200}
Jun 02 16:40:50.294917 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Pushing event updated for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:50.301107 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:50.363842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-29c97050-ff69-4de0-9651-8064c660df51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:50.365856 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-29c97050-ff69-4de0-9651-8064c660df51 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 1096 time: 0.2104356
Jun 02 16:40:50.430470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b7b8442b0>> subnet after_create 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.430975 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b7b8442b0>> subnet after_delete 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.431307 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b7b8442b0>> subnet before_create 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.431633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b7b8442b0>> subnet before_update 55550000 {{(pid=98278) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:40:50.431993 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7bbf5fa0>,) {'filters': {'network_id': ['532c19ad-7fb3-433c-aca6-49e204fc4e0a']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:50.462368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7bbf5fa0>, '2a3b7d6f-3bce-424d-998a-2b62194e256e') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:50.462640 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7bbf5fa0>, '2a3b7d6f-3bce-424d-998a-2b62194e256e') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:50.493203 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.505587 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-f101ea04-54e1-4b69-b49d-e60b357936ac service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb HTTP/1.1" status: 200  len: 217 time: 0.1304572
Jun 02 16:40:50.534912 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.558417 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Releasing vlan 661 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:40:50.559012 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   from cryptography.utils import int_from_bytes
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   from cryptography.utils import int_from_bytes
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:40:50.639060 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:40:50.662420 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-e5004569-c895-4db8-96f6-400db0df15fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:50.665447 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-e5004569-c895-4db8-96f6-400db0df15fe service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1444371
Jun 02 16:40:50.763560 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-126798a0-6efd-467c-8c5f-8da260faee8f service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0905151
Jun 02 16:40:50.964600 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-d3a2732e-fff2-4161-a1a6-78721fd9f846 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1927090
Jun 02 16:40:51.004910 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:51.011544 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:51.055336 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:51.078057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Pushing event deleted for resources: {'Network': ['ID=532c19ad-7fb3-433c-aca6-49e204fc4e0a,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:51.087256 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] 10.222.0.25 "DELETE /v2.0/networks/532c19ad-7fb3-433c-aca6-49e204fc4e0a HTTP/1.1" status: 204  len: 168 time: 1.3533170
Jun 02 16:40:51.088255 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:51.090109 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50040) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:51.257513 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Deleting subnet 40833f12-9d12-443c-9fc7-58161f52c517 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:40:51.263067 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:51.328486 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:51.371810 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3749811-9656-4588-83a6-401ead64505a req-ce4c19b6-377e-42f1-9713-04dab244267b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:51.379411 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3749811-9656-4588-83a6-401ead64505a req-ce4c19b6-377e-42f1-9713-04dab244267b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2101936
Jun 02 16:40:51.439539 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:51.475924 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3749811-9656-4588-83a6-401ead64505a req-83c53546-c431-4458-b999-1386daddd85d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0954607
Jun 02 16:40:51.488019 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6ade1d04-3a62-40f6-98a8-75322fee2fdc req-382ba811-1ce9-430f-b3cc-b80589d6e4e6 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5142457
Jun 02 16:40:51.550176 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63272226-22f4-47a9-8630-9e3d720d3ab3 req-0f72236a-e1c7-443b-a8a9-963c72f4ef32 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:51.553279 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63272226-22f4-47a9-8630-9e3d720d3ab3 req-0f72236a-e1c7-443b-a8a9-963c72f4ef32 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 943 time: 0.2744529
Jun 02 16:40:51.776783 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63272226-22f4-47a9-8630-9e3d720d3ab3 req-7bbf4455-bab9-42d3-bae4-028dfc7d5e9f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2089963
Jun 02 16:40:51.825730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81169720-07da-4ee8-a223-1d88a2f01150 req-38c3119b-b3da-4734-8a54-20da545d81d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:51.828295 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-38c3119b-b3da-4734-8a54-20da545d81d2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 1096 time: 0.2130086
Jun 02 16:40:51.981124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.015469 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:52.110624 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=40833f12-9d12-443c-9fc7-58161f52c517,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:52.116693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:52.153674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.173150 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/40833f12-9d12-443c-9fc7-58161f52c517 HTTP/1.1" status: 204  len: 168 time: 1.0774090
Jun 02 16:40:52.179362 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50064) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:52.215897 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27ceaba-3ce9-4591-aea5-029be6927cc6 req-a7e796d2-da82-45a9-966d-b1f34277756f tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:52.222609 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e27ceaba-3ce9-4591-aea5-029be6927cc6 req-a7e796d2-da82-45a9-966d-b1f34277756f tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.3885694
Jun 02 16:40:52.301057 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81169720-07da-4ee8-a223-1d88a2f01150 req-365e1715-05b7-44c3-ab17-6edea59c37e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:52.304071 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-365e1715-05b7-44c3-ab17-6edea59c37e2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 915 time: 0.4549649
Jun 02 16:40:52.370376 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e27ceaba-3ce9-4591-aea5-029be6927cc6 req-d1d83664-26ec-4d8a-85ca-565422962049 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1467595
Jun 02 16:40:52.377715 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.405848 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-4a6219e2-9d34-48e5-bd63-d1254ed58b9f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb HTTP/1.1" status: 200  len: 217 time: 0.0871575
Jun 02 16:40:52.541787 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81169720-07da-4ee8-a223-1d88a2f01150 req-80ee479f-f72b-4863-b229-dd9db165ed23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:52.551873 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-80ee479f-f72b-4863-b229-dd9db165ed23 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1313806
Jun 02 16:40:52.629555 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-1d4b2949-b7b2-483f-9205-d1289173eba9 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0734422
Jun 02 16:40:52.639202 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.666590 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac49fa0>,) {'filters': {'network_id': ['a66579cc-0355-4898-a988-bc6983920587']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:52.685952 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac49fa0>, 'b119e8e7-4188-48b1-8aab-e1ff1eb5323d') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:52.686246 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac49fa0>, 'b119e8e7-4188-48b1-8aab-e1ff1eb5323d') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:40:52.709587 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.733122 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.745981 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Releasing vlan 672 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:40:52.747074 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:40:52.870289 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:40:52.877670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.882664 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:52.902531 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:52.914336 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Pushing event deleted for resources: {'Network': ['ID=a66579cc-0355-4898-a988-bc6983920587,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:52.917356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:52.921443 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] 10.222.0.25 "DELETE /v2.0/networks/a66579cc-0355-4898-a988-bc6983920587 HTTP/1.1" status: 204  len: 168 time: 0.7385700
Jun 02 16:40:52.944721 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-ed8dba0b-a4ad-4306-9bb4-5b29b16d6437 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2991745
Jun 02 16:40:52.956749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3171554-a45e-4f5a-ada6-daa595a28325 req-957285a6-c3c7-4ad3-98d4-972845d1a79b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:52.959097 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d3171554-a45e-4f5a-ada6-daa595a28325 req-957285a6-c3c7-4ad3-98d4-972845d1a79b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2796075
Jun 02 16:40:53.131127 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d3171554-a45e-4f5a-ada6-daa595a28325 req-e2d91d69-7369-45a1-861a-57dbd157bf09 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1511638
Jun 02 16:40:53.223437 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81169720-07da-4ee8-a223-1d88a2f01150 req-73d2a02f-0f1d-40e7-9392-9a1b8845fa03 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2593756
Jun 02 16:40:53.291757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7168c0-b577-4f1f-b808-3a82a8df2a29 req-54a6112b-7079-496a-886b-204da97a083b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:53.300357 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0e7168c0-b577-4f1f-b808-3a82a8df2a29 req-54a6112b-7079-496a-886b-204da97a083b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 943 time: 0.1519337
Jun 02 16:40:53.349250 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0e7168c0-b577-4f1f-b808-3a82a8df2a29 req-85ad4006-7489-4016-89ea-c13cfdb0d21f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473487
Jun 02 16:40:53.504291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50102) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:53.590726 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6f31359d-beeb-479c-9f42-8225acad0a7a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3747befb35a14028a0d6f65f3cab9553&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0820553
Jun 02 16:40:53.590930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50108) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:53.644835 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50112) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:53.695496 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:53.707563 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device aa2c51f5-ce26-4924-b07d-2fd35ef89adb details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:40:53.759369 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:53.870939 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:53.876052 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e3e4f8fc-d642-481f-a32a-43aa7ced19e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:53.885515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-03653e47-96de-4601-8163-ee231b947d50 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:53.887307 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-03653e47-96de-4601-8163-ee231b947d50 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.20 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.3024452
Jun 02 16:40:53.901372 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08ef715-eedc-4ca5-9f8c-3b525a2446cd req-3ebf200a-32cd-4dd5-8135-6c9277cc4867 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:53.908928 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d08ef715-eedc-4ca5-9f8c-3b525a2446cd req-3ebf200a-32cd-4dd5-8135-6c9277cc4867 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 946 time: 0.2574234
Jun 02 16:40:53.934335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c100486-50da-4956-8877-bc3b6150249a,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:53.942808 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:53.954905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:53.962811 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:53.963949 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5c100486-50da-4956-8877-bc3b6150249a HTTP/1.1" status: 204  len: 168 time: 0.3721483
Jun 02 16:40:53.967855 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:53.974637 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:53.983626 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Usage tracker for resource:security_group_rule and tenant:510f0cd227994bb6ba43d08e0c034d63 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:53.989066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:53.996380 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'port_id': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', 'mac_address': 'fa:16:3e:7b:39:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 679, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '409c7043-b3b6-42f7-90b5-f7db5d717e70', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:40:54.009400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:54.064267 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d08ef715-eedc-4ca5-9f8c-3b525a2446cd req-fac23421-86b8-4422-9029-6e2b10c84fac tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/security-groups?id=0c0fd46d-f333-49cc-8e5f-1a09d571462c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1542628
Jun 02 16:40:54.118057 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.137990 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.148634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.153989 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Deleting port adaa7944-ce71-4265-bd85-afb28a3d7c81 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:40:54.154568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.159389 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa2c51f5-ce26-4924-b07d-2fd35ef89adb {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:40:54.164751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5c05fb4f-750b-402d-bf5f-4ab518720507 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:54.205347 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:54.212076 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.215346 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-52f7fdd3-7766-4a1f-9d7d-4ce5e467ad76 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:54.232603 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=510f0cd227994bb6ba43d08e0c034d63&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5862565
Jun 02 16:40:54.233929 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50130) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:54.234853 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4798aee-2d9f-43a0-9f8d-6d078a339925,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:54.293307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:54.303297 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.303621 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.303952 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.304281 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.304597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.305013 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.305340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.305806 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.306148 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.306538 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.306854 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.307386 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:40:54.315472 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:54.345398 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:54.388529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] For port adaa7944-ce71-4265-bd85-afb28a3d7c81, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adaa7944-ce71-4265-bd85-afb28a3d7c81,segment=NetworkSegment(a06ec11a-1aa9-49e2-824a-cb70c50736bf),segment_id=a06ec11a-1aa9-49e2-824a-cb70c50736bf)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:54.388890 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.405975 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.494559 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.529831 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50136) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:54.551956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Calling delete_port for adaa7944-ce71-4265-bd85-afb28a3d7c81 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:40:54.639566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce22b4b-8d4f-4dfa-b70d-894185dc5b80 req-1909cddb-2e59-489c-9f85-e7d471fd8beb tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:54.641174 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0ce22b4b-8d4f-4dfa-b70d-894185dc5b80 req-1909cddb-2e59-489c-9f85-e7d471fd8beb tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2373154
Jun 02 16:40:54.652844 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['aa2c51f5-ce26-4924-b07d-2fd35ef89adb'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:54.655704 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.659914 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-85604762-ab95-4590-845b-5929ff1092ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:54.686037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4798aee-2d9f-43a0-9f8d-6d078a339925,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:54.693453 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:54.700915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.705110 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b4798aee-2d9f-43a0-9f8d-6d078a339925 HTTP/1.1" status: 204  len: 168 time: 0.4542305
Jun 02 16:40:54.718545 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f414139b-56d5-4d3c-aa64-a3e66c6d5902 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b9982fccfaba4b8280277f3a8047b841&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1842794
Jun 02 16:40:54.719764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50140) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:54.729852 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0ce22b4b-8d4f-4dfa-b70d-894185dc5b80 req-2ec55a0c-17e4-4a40-b38e-511cac8381dd tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0612233
Jun 02 16:40:54.905019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:54.925198 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9169a43c-5b77-4c07-a19d-f11f25f35416 req-a55f94c9-9b46-4d30-96a9-cdcc7f87db98 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:54.926719 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9169a43c-5b77-4c07-a19d-f11f25f35416 req-a55f94c9-9b46-4d30-96a9-cdcc7f87db98 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 944 time: 0.2820723
Jun 02 16:40:55.014164 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.063649 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9169a43c-5b77-4c07-a19d-f11f25f35416 req-d4d19aa3-5421-408d-9e79-4c8266cb6e45 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1023791
Jun 02 16:40:55.072037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.091064 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:55.133281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Pushing event deleted for resources: {'Port': ['ID=adaa7944-ce71-4265-bd85-afb28a3d7c81,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:55.137470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:55.159133 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50150) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:55.185357 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.205218 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:55.218756 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] No DVR routers for this DVR port adaa7944-ce71-4265-bd85-afb28a3d7c81 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:40:55.222403 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.225225 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.227864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'name': 'network-vif-deleted', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:55.230568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5257c0f2-6848-434c-852c-08cd15093252" -d '{"events": [{"server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "name": "network-vif-deleted", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:55.235586 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e0edc327-0128-4056-bc7e-4d133f0c92a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:55.253533 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=846e75d3-c46e-4661-9245-5a22a6e4f060,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:55.256459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:55.271092 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-436b9f41-2875-4bd4-bd87-963e3bec3d05 req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.20 "DELETE /v2.0/ports/adaa7944-ce71-4265-bd85-afb28a3d7c81 HTTP/1.1" status: 204  len: 173 time: 1.3599875
Jun 02 16:40:55.272108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.273099 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/846e75d3-c46e-4661-9245-5a22a6e4f060 HTTP/1.1" status: 204  len: 168 time: 0.5523686
Jun 02 16:40:55.274392 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f56475e6-e22d-445d-89d6-5f5b3221a275 req-565a7a33-d007-4c01-980b-f6c02e816cf1 tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.0738232
Jun 02 16:40:55.278800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Usage tracker for resource:security_group_rule and tenant:e35746159c80431c8fea500d7ce72555 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:55.282901 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:55.316944 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:55.344703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0be1de59-e8bd-4843-9f27-a0b292950628 x-openstack-request-id: req-0be1de59-e8bd-4843-9f27-a0b292950628 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:55.345002 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a2a6dac1-694b-40a2-aa6b-e40239d60463", "name": "network-vif-deleted", "tag": "adaa7944-ce71-4265-bd85-afb28a3d7c81", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:55.345310 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0be1de59-e8bd-4843-9f27-a0b292950628 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:55.345744 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a2a6dac1-694b-40a2-aa6b-e40239d60463', 'name': 'network-vif-deleted', 'tag': 'adaa7944-ce71-4265-bd85-afb28a3d7c81', 'status': 'completed', 'code': 200}
Jun 02 16:40:55.456174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.460884 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.469456 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:55.482221 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['adaa7944-ce71-4265-bd85-afb28a3d7c81'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:40:55.516043 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e35746159c80431c8fea500d7ce72555&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3524477
Jun 02 16:40:55.516043 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a775672-29d0-41b6-b879-463a4b86c5a2,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:55.516358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50162) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:55.517504 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:55.610061 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.663699 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.711228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device aa2c51f5-ce26-4924-b07d-2fd35ef89adb up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:40:55.742530 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50170) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:55.779328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.787844 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:55.823058 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4f799b37-0ddc-4f52-9cb2-f49f6c35984e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.829104 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a775672-29d0-41b6-b879-463a4b86c5a2,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:55.834107 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:55.837990 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/9a775672-29d0-41b6-b879-463a4b86c5a2 HTTP/1.1" status: 204  len: 168 time: 0.3178046
Jun 02 16:40:55.837990 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:55.838974 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port aa2c51f5-ce26-4924-b07d-2fd35ef89adb completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:40:55.854105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port aa2c51f5-ce26-4924-b07d-2fd35ef89adb triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:40:55.854585 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.004395 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.034128 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff901329-762d-4006-b40d-6258dc21391c req-96446f2f-71af-4132-91c9-c4cbce587450 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:56.037087 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:40:56.038540 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ff901329-762d-4006-b40d-6258dc21391c req-96446f2f-71af-4132-91c9-c4cbce587450 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1065528
Jun 02 16:40:56.039614 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b147b85-2552-4fbe-b5e8-feb570dc435f" -d '{"events": [{"server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "name": "network-vif-plugged", "status": "completed", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:40:56.065084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:40:56.072118 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.075067 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adaa7944-ce71-4265-bd85-afb28a3d7c81 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:40:56.110860 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ff901329-762d-4006-b40d-6258dc21391c req-554de4ae-e12c-4faf-a6b8-1535161d9c6b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658326
Jun 02 16:40:56.123630 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:40:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27ee2c3d-77bd-4b0a-bbc3-120592438e76 x-openstack-request-id: req-27ee2c3d-77bd-4b0a-bbc3-120592438e76 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:40:56.123974 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "name": "network-vif-plugged", "status": "completed", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:40:56.124205 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-27ee2c3d-77bd-4b0a-bbc3-120592438e76 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:40:56.124784 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', 'code': 200}
Jun 02 16:40:56.125214 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:56.191750 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: adaa7944-ce71-4265-bd85-afb28a3d7c81 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:40:56.192102 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adaa7944-ce71-4265-bd85-afb28a3d7c81 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:40:56.197381 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.211832 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:56.215915 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:56.229391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:56.239541 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Usage tracker for resource:security_group_rule and tenant:6faded3981da475fab64d046938825c8 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:56.243452 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:56.257956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:56.330814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81de37a2-6326-4386-b1b5-e0bd988e07fe req-c9602b54-2b35-48bc-85cf-225c02afd7b7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:56.332677 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-81de37a2-6326-4386-b1b5-e0bd988e07fe req-c9602b54-2b35-48bc-85cf-225c02afd7b7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.1149685
Jun 02 16:40:56.402019 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-81de37a2-6326-4386-b1b5-e0bd988e07fe req-1698fd36-1db0-417c-b7d8-3060bc88c4f3 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0615079
Jun 02 16:40:56.453738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.465032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.465503 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50192) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:56.482214 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:56.575879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-70163ad3-9328-45dc-b2b4-e1353f266899 req-d3386c8c-93fc-450e-b07a-7d7e21fb9dff tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Synchronizing usage tracker for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:56.583117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40522e11-6af6-43fd-a6a3-b5b9e0fadc73,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:56.587664 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:56.593515 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6faded3981da475fab64d046938825c8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8469057
Jun 02 16:40:56.593786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50202) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:56.614020 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1897f189-bc35-45c8-b623-75182ba6d3b6 req-4fa9d928-2364-447d-8a3f-d44d19d340c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:56.616053 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1897f189-bc35-45c8-b623-75182ba6d3b6 req-4fa9d928-2364-447d-8a3f-d44d19d340c9 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 1098 time: 0.2627368
Jun 02 16:40:56.622262 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-70163ad3-9328-45dc-b2b4-e1353f266899 req-d3386c8c-93fc-450e-b07a-7d7e21fb9dff tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Unset dirty status for tenant:a940e65f547649a6b5dbd349c6239cbc on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:56.625018 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-70163ad3-9328-45dc-b2b4-e1353f266899 req-d3386c8c-93fc-450e-b07a-7d7e21fb9dff tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] 10.222.0.25 "GET /v2.0/ports?device_id=a2a6dac1-694b-40a2-aa6b-e40239d60463 HTTP/1.1" status: 200  len: 210 time: 0.1286283
Jun 02 16:40:56.679402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1897f189-bc35-45c8-b623-75182ba6d3b6 req-0d605846-6614-4476-8ab8-bca769a2e97b service neutron] Synchronizing usage tracker for tenant:90adabc121ea41c8a95252bc1c7291c2 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:40:56.702426 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1897f189-bc35-45c8-b623-75182ba6d3b6 req-0d605846-6614-4476-8ab8-bca769a2e97b service neutron] Unset dirty status for tenant:90adabc121ea41c8a95252bc1c7291c2 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:40:56.703651 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1897f189-bc35-45c8-b623-75182ba6d3b6 req-0d605846-6614-4476-8ab8-bca769a2e97b service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0765693
Jun 02 16:40:56.712946 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.746361 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.821440 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.827392 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f7bab4ef-813d-464e-abed-c37e170edeb5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:56.841695 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40522e11-6af6-43fd-a6a3-b5b9e0fadc73,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:56.845582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:56.868193 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.870156 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/40522e11-6af6-43fd-a6a3-b5b9e0fadc73 HTTP/1.1" status: 204  len: 168 time: 0.2751493
Jun 02 16:40:56.936126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:56.950908 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-8fc2a7d6-5182-48b6-8b0c-5b989d4d6f2f service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0762463
Jun 02 16:40:56.962143 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:56.969246 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Usage tracker for resource:security_group_rule and tenant:6d1b7cc089c64155bcb01bbaa255d02e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:56.974143 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:56.982547 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:57.122266 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-f63f67af-ba14-4216-9492-e01b31390142 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:57.124819 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-f63f67af-ba14-4216-9492-e01b31390142 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 1098 time: 0.0897295
Jun 02 16:40:57.174951 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.185648 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.217575 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-460b9ba3-ff74-4a5e-88d7-6cb0efa40e5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:57.314518 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6d1b7cc089c64155bcb01bbaa255d02e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8441451
Jun 02 16:40:57.314518 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=576cefed-eec6-48fb-973a-12fc2214edcc,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:57.320634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:57.321480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50224) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:57.388168 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50230) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:57.415013 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.459111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:57.463633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.491320 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Usage tracker for resource:security_group_rule and tenant:3d0fb79e47ad4cc7b4f50f2bd2125c99 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:57.497119 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:57.526223 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-0e9592b5-dfe3-4009-b8aa-51ec6b581199 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:57.526350 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:57.528358 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-0e9592b5-dfe3-4009-b8aa-51ec6b581199 service neutron] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 915 time: 0.3801897
Jun 02 16:40:57.548868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.648977 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-a83859bc-e806-4d4d-b12d-630fe9c6537d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3 HTTP/1.1" status: 200  len: 217 time: 0.1127691
Jun 02 16:40:57.725865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd76c18c-5e80-4e0e-91ca-53fc4e2b34a8 req-1fc449c4-b1a6-4839-8f1a-b7e14f05b992 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:57.727631 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd76c18c-5e80-4e0e-91ca-53fc4e2b34a8 req-1fc449c4-b1a6-4839-8f1a-b7e14f05b992 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.4461911
Jun 02 16:40:57.760243 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.773432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-97706a0e-eba0-4a7d-97b2-81042b5f2f42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:57.785452 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-27bac303-0293-4d76-9a80-2ca2a139d05f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:57.787683 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-27bac303-0293-4d76-9a80-2ca2a139d05f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1281466
Jun 02 16:40:57.799650 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd76c18c-5e80-4e0e-91ca-53fc4e2b34a8 req-d4392948-de4b-4b21-a630-0ec549de3823 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0642123
Jun 02 16:40:57.838029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:57.844635 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/576cefed-eec6-48fb-973a-12fc2214edcc HTTP/1.1" status: 204  len: 168 time: 0.5192380
Jun 02 16:40:57.851851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=576cefed-eec6-48fb-973a-12fc2214edcc,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:57.857580 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-1923403b-1ac4-4858-b8c4-e080ab303e42 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0568662
Jun 02 16:40:57.898262 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:57.948672 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d75f87-4d55-42b6-9138-2621824a638d req-84b1c8ce-910c-404a-99b2-c40d743eb09e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:57.951676 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e3d75f87-4d55-42b6-9138-2621824a638d req-84b1c8ce-910c-404a-99b2-c40d743eb09e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.2980008
Jun 02 16:40:58.093494 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e3d75f87-4d55-42b6-9138-2621824a638d req-ef0a691e-0b5f-4f1d-93b0-c5df08c8aa9f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1250136
Jun 02 16:40:58.103794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.112286 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.130554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a9e49ca2-a4e6-4169-ba69-97eb1fa5b681 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:58.238854 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-4375dea0-e94c-4db3-aa81-d43a5ef82ceb service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3715189
Jun 02 16:40:58.280302 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3d0fb79e47ad4cc7b4f50f2bd2125c99&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8808446
Jun 02 16:40:58.281410 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50256) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:58.324409 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94e44522-c993-477e-bf3f-658e37b98731,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:58.351190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:58.416200 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.473634 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ef859c33-ab07-4902-856a-8473543d3cad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.502183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.654902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.667685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:58.688695 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94e44522-c993-477e-bf3f-658e37b98731,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:58.692862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:58.721061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.723560 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50264) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:58.724177 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/94e44522-c993-477e-bf3f-658e37b98731 HTTP/1.1" status: 204  len: 168 time: 0.4389348
Jun 02 16:40:58.745559 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b94140bb-8953-4e71-9407-0f0cd542b420 req-959a8b4f-7771-4952-8dfa-f33fd5dd638b service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4975188
Jun 02 16:40:58.770202 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.786863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:58.814015 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:40:58.819846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Usage tracker for resource:security_group_rule and tenant:38ef2a3eaa9144d3ac651835fc47fb8f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:40:58.827838 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:40:58.845425 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:40:59.108129 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.114340 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.135521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-796a61b4-3d02-4cdb-b35b-96706c3a3d57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:59.284099 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b6e248-b3a7-49f6-a15f-3e086c528655 req-a5fbe40d-0c19-4577-a10f-b9e6d8aee1c6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:59.300884 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57b6e248-b3a7-49f6-a15f-3e086c528655 req-a5fbe40d-0c19-4577-a10f-b9e6d8aee1c6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2791245
Jun 02 16:40:59.314607 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=38ef2a3eaa9144d3ac651835fc47fb8f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5852373
Jun 02 16:40:59.314607 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e90dfff-ec23-4274-9889-6c7210a53b29,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:59.330396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50286) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:40:59.430272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:40:59.587725 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57b6e248-b3a7-49f6-a15f-3e086c528655 req-c48014a7-71bc-4a49-8e90-b7c5b168cfd7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2848797
Jun 02 16:40:59.590118 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.642899 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.674094 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21c02b0-1e69-4f8f-a3ed-3b64fb02cc44 req-5cb6b762-eba8-4b29-9030-d9bf5c9e8d59 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:40:59.681429 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f21c02b0-1e69-4f8f-a3ed-3b64fb02cc44 req-5cb6b762-eba8-4b29-9030-d9bf5c9e8d59 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.2384470
Jun 02 16:40:59.769592 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f21c02b0-1e69-4f8f-a3ed-3b64fb02cc44 req-2005f079-7fc7-460f-9a7e-ccea266673c8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0872192
Jun 02 16:40:59.794201 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.807088 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a83fe206-bdfa-4b12-89c9-874c54e93c72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:40:59.825467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e90dfff-ec23-4274-9889-6c7210a53b29,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:40:59.828505 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:40:59.829738 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8e90dfff-ec23-4274-9889-6c7210a53b29 HTTP/1.1" status: 204  len: 168 time: 0.4888146
Jun 02 16:40:59.830728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:00.186340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:00.466896 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50338) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:00.654989 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Deleting subnet caf8e91b-8d46-4a47-a396-8ce21c092e9d {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:41:00.664658 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:00.802319 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:00.826021 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.118301 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac20d28e-951e-4930-80bb-66d49b05f8a4 req-4b1d638f-0216-4fc7-b9d8-858c430e9967 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:01.120132 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac20d28e-951e-4930-80bb-66d49b05f8a4 req-4b1d638f-0216-4fc7-b9d8-858c430e9967 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2446785
Jun 02 16:41:01.242251 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac20d28e-951e-4930-80bb-66d49b05f8a4 req-49e59823-90c0-46f8-8724-121d84712681 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1146579
Jun 02 16:41:01.418539 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.432825 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:01.483633 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.486958 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Pushing event deleted for resources: {'Subnet': ['ID=caf8e91b-8d46-4a47-a396-8ce21c092e9d,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:01.490574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:01.500768 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] 10.222.0.25 "DELETE /v2.0/subnets/caf8e91b-8d46-4a47-a396-8ce21c092e9d HTTP/1.1" status: 204  len: 168 time: 1.0319781
Jun 02 16:41:01.505647 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50384) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:01.621399 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.662242 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50390) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:01.766138 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.780727 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f9b7753cd60>> segment before_delete 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.781099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f9b7753cd60>> subnet precommit_delete_associations 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.782149 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> segment_host_mapping after_create 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.782501 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> port after_create 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.782795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> port after_delete 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.783419 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> port after_update 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.783939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> segment after_delete 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.784612 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> subnet after_create 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.785224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> subnet after_delete 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.785889 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f9b778d37f0>> subnet after_update 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.838707 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-841014032-network', 'tenant_id': 'a1836d0c3dbd473ca08d38562b52e19d'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:01.843965 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:01.848594 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Usage tracker for resource:network and tenant:a1836d0c3dbd473ca08d38562b52e19d is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:01.852316 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:01.859125 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b76c6a9d0>> subnet after_create 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.860567 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b76c6a9d0>> subnet after_delete 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.860686 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:01.860822 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b76c6a9d0>> subnet before_create 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.861487 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f9b76c6a9d0>> subnet before_update 55550000 {{(pid=98277) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 02 16:41:01.861896 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7753c9d0>,) {'filters': {'network_id': ['8d1e36c6-d295-4363-85e5-dce458b299cc']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:01.880624 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Made reservation on behalf of a1836d0c3dbd473ca08d38562b52e19d for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:01.882937 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.885417 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.885679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7753c9d0>, 'a06ec11a-1aa9-49e2-824a-cb70c50736bf') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:01.885892 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7753c9d0>, 'a06ec11a-1aa9-49e2-824a-cb70c50736bf') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:01.901947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.908631 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.925513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.935143 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Releasing vlan 655 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:41:01.935663 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:01.947637 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   from cryptography.utils import int_from_bytes
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   from cryptography.utils import int_from_bytes
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:41:01.953353 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:41:01.961348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Usage tracker for resource:security_group_rule and tenant:a1836d0c3dbd473ca08d38562b52e19d is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:01.967370 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:01.981204 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:02.050425 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.055382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:02.078223 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.087130 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Pushing event deleted for resources: {'Network': ['ID=8d1e36c6-d295-4363-85e5-dce458b299cc,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:02.092808 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:02.107297 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-fad2be62-1031-4e05-bdf0-e7e5a87e4d54 admin admin] 10.222.0.25 "DELETE /v2.0/networks/8d1e36c6-d295-4363-85e5-dce458b299cc HTTP/1.1" status: 204  len: 168 time: 0.6013575
Jun 02 16:41:02.209541 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.218293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.223787 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:02.246409 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] vlan segment allocate from pool success with {'vlan_id': 654, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:41:02.281692 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd0a0b0d-fc16-4932-8115-906cb70c4047,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:02.285188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.285531 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Added segment 2b0ce5ce-fbb7-47ce-a4be-382c2e52a877 of type vlan for network 02df58b0-f30e-4a68-b09a-14d590111b4f
Jun 02 16:41:02.287543 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:02.325101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.369791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50418) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:02.385387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.388047 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:02.388915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.393754 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e8a4789b-97ce-4f19-a6a3-730bd742c7c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:02.441580 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-663b8c82-799d-47f2-a494-3a6fd8af95d6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a940e65f547649a6b5dbd349c6239cbc&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0700572
Jun 02 16:41:02.442348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50422) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:02.517261 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Pushing event updated for resources: {'Network': ['ID=02df58b0-f30e-4a68-b09a-14d590111b4f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:02.522037 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.8581991
Jun 02 16:41:02.524801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:02.530068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50426) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:02.533866 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Request body: {'subnet': {'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-841014032-subnet', 'tenant_id': 'a1836d0c3dbd473ca08d38562b52e19d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:02.537506 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 02df58b0-f30e-4a68-b09a-14d590111b4f details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:41:02.539778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.541023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:02.549950 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Usage tracker for resource:subnet and tenant:a1836d0c3dbd473ca08d38562b52e19d is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:02.555230 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:02.578975 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.607072 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:02.652774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.658552 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:02.659617 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Made reservation on behalf of a1836d0c3dbd473ca08d38562b52e19d for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:02.663415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.677994 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c0fd46d-f333-49cc-8e5f-1a09d571462c,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:02.682108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:02.688707 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:02.690462 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0c0fd46d-f333-49cc-8e5f-1a09d571462c HTTP/1.1" status: 204  len: 168 time: 0.2464914
Jun 02 16:41:02.871169 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1ab628-5b56-4e83-bf4d-891778160c0b req-9fc53711-6d59-495e-9001-ac31a2004487 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:02.872835 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6a1ab628-5b56-4e83-bf4d-891778160c0b req-9fc53711-6d59-495e-9001-ac31a2004487 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.3190234
Jun 02 16:41:02.983906 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6a1ab628-5b56-4e83-bf4d-891778160c0b req-a5bfe1f0-f599-485d-8b8b-411481762026 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1044979
Jun 02 16:41:03.088304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50442) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:03.305582 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.330136 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:03.334939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Usage tracker for resource:security_group_rule and tenant:24bf3f83518f40f4b244735b8c2f9549 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:03.338732 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:03.346789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:03.383564 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.400302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:03.484310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Pushing event updated for resources: {'Subnet': ['ID=20e402a0-b7ee-4669-88f8-ad03a86eca35,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:03.489411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Checking segment: {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:03.489885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Network hostable DHCP agents. Network: 02df58b0-f30e-4a68-b09a-14d590111b4f, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:41:03.504640 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:03.528439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.534761 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.536862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Network 02df58b0-f30e-4a68-b09a-14d590111b4f is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:41:03.569562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 02df58b0-f30e-4a68-b09a-14d590111b4f) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:03.580265 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-37eeea19-2a00-4dbd-9b6d-777e8c77d568 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:03.584846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9676d5d3-68be-4e3a-8403-02526aff62f8 None None] Network 02df58b0-f30e-4a68-b09a-14d590111b4f requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:03.590500 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=24bf3f83518f40f4b244735b8c2f9549&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5001669
Jun 02 16:41:03.592023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50464) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:03.616024 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:03.616620 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.623110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7dbc984-aeff-4260-9416-ccbf8e1e3235,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:03.627292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:03.678679 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e8e946b0-713f-4dc4-ba83-a30c1b740f5b admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1413677
Jun 02 16:41:03.702741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.735716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.788252 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.802560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.809313 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a8a81636-955b-4b58-958f-b31f15df4363 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:03.823041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7dbc984-aeff-4260-9416-ccbf8e1e3235,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:03.831237 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:03.833435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:03.834597 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a7dbc984-aeff-4260-9416-ccbf8e1e3235 HTTP/1.1" status: 204  len: 168 time: 0.2412193
Jun 02 16:41:03.857640 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50476) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:03.916125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-567f83f2-0ce5-4061-9023-1b3b45a02e74 None None] Network 02df58b0-f30e-4a68-b09a-14d590111b4f requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:04.179094 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1982840299-network', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:04.184571 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:04.190136 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Usage tracker for resource:network and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:04.194272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:04.201403 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:04.222456 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Made reservation on behalf of 5febf86d75284ccb9dac5e0dadffd715 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:04.224820 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.245780 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.263545 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:04.269257 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:04.279261 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6932e5d6-a685-4018-bad4-9598b9bc4563 req-9de16299-f629-4e3e-a645-d9d1ade62cc4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:04.286505 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6932e5d6-a685-4018-bad4-9598b9bc4563 req-9de16299-f629-4e3e-a645-d9d1ade62cc4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1569493
Jun 02 16:41:04.290284 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:04.324216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:04.325284 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50490) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:04.351246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.377422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:04.390833 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Usage tracker for resource:security_group_rule and tenant:4efce088eeac4928a8bb74aaf13e4fdc is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:04.395204 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:04.397715 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6932e5d6-a685-4018-bad4-9598b9bc4563 req-330eba76-1b26-44c3-8697-54f5a1480d7d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1097052
Jun 02 16:41:04.407335 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:04.490570 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.497310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.504320 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-be7f8266-4c98-47fd-abe7-ff7c92a3a75f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:04.547337 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] vlan segment allocate from pool success with {'vlan_id': 695, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:41:04.570786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d2dd46c-567a-4898-8c2f-7c9f820c9253,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:04.576791 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:04.582921 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.583361 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Added segment a4855202-de9c-405c-afa8-a9d92ac32eb4 of type vlan for network 715517d1-0353-4b9d-972e-92eb6241fe32
Jun 02 16:41:04.592673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.602351 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.616762 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-29e818f4-f513-4c1e-8943-c96b30d92f34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:04.638847 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.664321 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9bb433e-099a-4351-a13b-6c2006e01c38,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:04.705892 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:04.723559 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4efce088eeac4928a8bb74aaf13e4fdc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3966444
Jun 02 16:41:04.726117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50500) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:04.731092 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.734178 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:04.735628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.756317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-66940f27-5e0b-44fa-a5d2-2c8fd84f4a53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:04.824179 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.857422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.889282 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.0310812
Jun 02 16:41:04.894610 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50502) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:04.895313 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Pushing event updated for resources: {'Network': ['ID=715517d1-0353-4b9d-972e-92eb6241fe32,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:04.899255 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:04.903096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Request body: {'subnet': {'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1982840299-subnet', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:04.909252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:04.909509 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 715517d1-0353-4b9d-972e-92eb6241fe32 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:41:04.914139 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Usage tracker for resource:subnet and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:04.917366 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:04.924069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:04.931331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.935134 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Made reservation on behalf of 5febf86d75284ccb9dac5e0dadffd715 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:04.937732 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f2ab054d-03bf-489d-9c75-64183ecf2fa0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:04.937895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.953050 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9bb433e-099a-4351-a13b-6c2006e01c38,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:04.956288 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:04.961129 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:04.965202 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b9bb433e-099a-4351-a13b-6c2006e01c38 HTTP/1.1" status: 204  len: 168 time: 0.2347884
Jun 02 16:41:05.362634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:05.366409 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b684bcd4-98be-42e9-966c-37b361165d85 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:05.438356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Pushing event updated for resources: {'Subnet': ['ID=200a3016-0d3b-4aef-b80d-de65cae94521,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:05.441190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:05.458663 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Checking segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:05.459029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Network hostable DHCP agents. Network: 715517d1-0353-4b9d-972e-92eb6241fe32, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:41:05.481141 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:41:05.491652 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 715517d1-0353-4b9d-972e-92eb6241fe32) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:05.502118 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5040232-6ac8-4046-a58e-51904968c7d4 None None] Network 715517d1-0353-4b9d-972e-92eb6241fe32 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:05.513560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:05.514190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:05.575358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50520) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:05.580918 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:05.582793 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 0.6846681
Jun 02 16:41:05.596396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:05.608714 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Usage tracker for resource:router and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:05.619606 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:05.632165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:05.658018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:05.659459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:05.695149 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:05.727432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8b4a4e-8589-4f91-ad87-7daf018e8ddc req-4ec0367e-95a3-4c81-ac66-57cbf68cab45 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:05.731181 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9f8b4a4e-8589-4f91-ad87-7daf018e8ddc req-4ec0367e-95a3-4c81-ac66-57cbf68cab45 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1460381
Jun 02 16:41:05.876594 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9f8b4a4e-8589-4f91-ad87-7daf018e8ddc req-8b0ba8b0-0850-43c7-aa8a-66231f8d8d4d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1274564
Jun 02 16:41:05.988037 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-715517d1-0353-4b9d-972e-92eb6241fe32', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:41:05.993065 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:06.290985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-774a24b6-4944-4caa-9a9a-bdf97d156092 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:06.298110 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-774a24b6-4944-4caa-9a9a-bdf97d156092 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.3022199
Jun 02 16:41:06.315089 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3f21c15d-d3e8-4e88-a1e8-41de2ee5caa1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/quotas/a3af7d82fba84269a3596d85213ae5e2 HTTP/1.1" status: 200  len: 375 time: 0.0160167
Jun 02 16:41:06.356252 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Allocated IP 172.20.0.2 (715517d1-0353-4b9d-972e-92eb6241fe32/200a3016-0d3b-4aef-b80d-de65cae94521/e8e6a355-ea57-49f2-8fe9-4a456c023a53) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:06.450651 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-f144f079-977b-43f3-93d2-c0d60640ff7c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1344848
Jun 02 16:41:06.498737 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:06.726168 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-b56eea77-d9f5-4e7b-a685-b9f43ed4ef08 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2740283
Jun 02 16:41:06.783527 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:06.795241 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Transition to ACTIVE for port object e8e6a355-ea57-49f2-8fe9-4a456c023a53 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:06.816106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Transition to ACTIVE for port object e8e6a355-ea57-49f2-8fe9-4a456c023a53 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:06.821781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-0a4de75f-0dde-4529-b3d9-f3067c81a5f5 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:06.823657 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-0a4de75f-0dde-4529-b3d9-f3067c81a5f5 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 808 time: 0.2803235
Jun 02 16:41:06.831417 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:06.838165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:06.916166 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-d15ee737-9a54-493e-aa64-654d3fce5fa3 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/quotas/a1836d0c3dbd473ca08d38562b52e19d HTTP/1.1" status: 200  len: 375 time: 0.0285301
Jun 02 16:41:06.934179 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:06.947395 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:06.956069 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:06.979963 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-0477ea22-226e-47dc-9ba8-445784fab678 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0550535
Jun 02 16:41:07.033814 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-ab39bd07-bead-4ecd-bf2c-4de06599dd91 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2974079
Jun 02 16:41:07.039669 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Pushing event updated for resources: {'Port': ['ID=e8e6a355-ea57-49f2-8fe9-4a456c023a53,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:07.053462 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:07.137323 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50584) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:07.237015 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Attempting to bind port e8e6a355-ea57-49f2-8fe9-4a456c023a53 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:07.237589 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Attempting to bind port e8e6a355-ea57-49f2-8fe9-4a456c023a53 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:07.244954 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Attempting to bind port e8e6a355-ea57-49f2-8fe9-4a456c023a53 on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:07.258921 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:07.259566 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Checking segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:07.271048 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.271744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Bound using segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:07.274136 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Bound port: e8e6a355-ea57-49f2-8fe9-4a456c023a53, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:07.277068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.296294 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.331936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:07.338863 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Usage tracker for resource:security_group_rule and tenant:a8fa968454134a97afd348f4cce9602d is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:07.344404 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:07.357044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:07.416862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] For port e8e6a355-ea57-49f2-8fe9-4a456c023a53, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:07.420840 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] For port e8e6a355-ea57-49f2-8fe9-4a456c023a53, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e8e6a355-ea57-49f2-8fe9-4a456c023a53,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:07.428393 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.433977 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:07.455747 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-c322b0da-f371-42fc-b3c0-584af16eb75a service neutron] 10.222.0.25 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3701320
Jun 02 16:41:07.516275 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Pushing event updated for resources: {'Port': ['ID=e8e6a355-ea57-49f2-8fe9-4a456c023a53,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:07.533322 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:07.539294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.556214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71885c23-21dc-48ba-a7d1-9aef398576d5 req-6f1109c3-bcd7-458b-a55e-66b33c869642 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:07.558062 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71885c23-21dc-48ba-a7d1-9aef398576d5 req-6f1109c3-bcd7-458b-a55e-66b33c869642 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2048411
Jun 02 16:41:07.626434 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.668827 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71885c23-21dc-48ba-a7d1-9aef398576d5 req-3cbf0986-ce0e-49c5-81f7-a1394274418d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0993361
Jun 02 16:41:07.674446 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.681152 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.696830 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-69dd6a19-8237-4c45-874e-2ad040f3c3a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:07.755438 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a8fa968454134a97afd348f4cce9602d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6195781
Jun 02 16:41:07.755438 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49b1e1b6-13c2-4516-947e-344478c2be1f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:07.757400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50602) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:07.770061 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-6560060a-f570-47a2-9dfc-cdb736e7027e service neutron] 10.222.0.25 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2954347
Jun 02 16:41:07.800782 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:07.856842 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.868443 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Allocated IP 172.27.0.147 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/8718120d-fc7a-424e-a11d-097b4d3a57d0) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:07.901742 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.980368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:07.987932 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d8b5e65e-d3b8-48d3-a239-292a1529aa4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:08.006022 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49b1e1b6-13c2-4516-947e-344478c2be1f,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:08.009258 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:08.011899 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:08.016301 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/49b1e1b6-13c2-4516-947e-344478c2be1f HTTP/1.1" status: 204  len: 168 time: 0.2578497
Jun 02 16:41:08.243609 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:08.301730 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f8ed88de-5349-4fa6-bbb2-dcb7bf079a7f req-6a7b95e9-41fa-4f2b-bc77-3c12dff35402 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0528321
Jun 02 16:41:08.337083 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:08.348551 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:08.499292 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-343fe381-fb4d-43be-8e41-57b10a39a996 req-15cd2265-c719-48c0-8af8-f721a3eea68e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.0672100
Jun 02 16:41:08.507431 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Pushing event updated for resources: {'Port': ['ID=8718120d-fc7a-424e-a11d-097b4d3a57d0,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:08.511096 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:08.513924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:08.515366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:08.518240 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:08.859388 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6676b448-158a-41b9-82c3-cedd4fb335cc None None] Network 715517d1-0353-4b9d-972e-92eb6241fe32 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:08.983042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e796f46c-e314-427d-80b3-8418fd9c8b91 None None] Provisioning for port e8e6a355-ea57-49f2-8fe9-4a456c023a53 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:09.073012 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50640) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:09.086398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.143979 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5c181e-ad1d-4284-a188-9064a79f2972 req-c70ebb10-a339-4ede-8176-a3584ba60b22 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:09.145527 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a5c181e-ad1d-4284-a188-9064a79f2972 req-c70ebb10-a339-4ede-8176-a3584ba60b22 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.3199518
Jun 02 16:41:09.218087 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a5c181e-ad1d-4284-a188-9064a79f2972 req-3a3653f0-73fb-4840-8643-e8f5a03f08b0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0663269
Jun 02 16:41:09.222198 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-40169272-network', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:09.227826 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:09.233133 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Usage tracker for resource:network and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:09.239608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:09.246532 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:09.262757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Made reservation on behalf of 2be2419a57e644b38a5c0ca942660a19 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:09.265739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.278597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.297505 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:09.306872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:09.310895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:09.321489 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:09.465456 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.471493 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.474972 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-88431e7f-6912-4ef5-ab1d-c32c602849bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:09.504693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] vlan segment allocate from pool success with {'vlan_id': 688, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:41:09.514624 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a0b351d-1055-4e55-8c34-de4c44baaa67,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:09.517725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:09.522027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.522855 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Added segment 335c4705-6fdd-4973-9624-acc92747502c of type vlan for network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca
Jun 02 16:41:09.546472 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a8e69d0b-a700-463a-a004-b52beaec252a req-edd63442-5215-42ad-b0d3-76922f81e9b0 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0800126
Jun 02 16:41:09.556996 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.601873 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.603757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:09.604345 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.608489 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-94872947-a8f2-4720-9eb8-a776d2b8c07a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:09.662332 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.689144 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e8e6a355-ea57-49f2-8fe9-4a456c023a53 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:09.733151 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.6580377
Jun 02 16:41:09.734648 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50650) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:09.735069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Pushing event updated for resources: {'Network': ['ID=00fea91a-5ad9-4ee8-ae53-59f9858b59ca,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:09.748630 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Request body: {'subnet': {'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-40169272-subnet', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:09.750646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:41:09.771329 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:09.773381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:09.783930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Usage tracker for resource:subnet and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:09.791026 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:09.805547 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:09.823910 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e4ef6291-d646-44ba-860c-ae217768ac8e req-342c4a75-681c-4624-90db-15526623cc8f tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.1574981
Jun 02 16:41:09.825284 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Made reservation on behalf of 2be2419a57e644b38a5c0ca942660a19 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:09.831612 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:09.953455 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port e8e6a355-ea57-49f2-8fe9-4a456c023a53 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:09.962540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port e8e6a355-ea57-49f2-8fe9-4a456c023a53 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:09.963044 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.128747 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.168476 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port e8e6a355-ea57-49f2-8fe9-4a456c023a53, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e8e6a355-ea57-49f2-8fe9-4a456c023a53,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:10.173068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.175363 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-29674f84-ea68-4f9f-a959-abd2a71f16b2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:10.187011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98277) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:41:10.251420 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=e8e6a355-ea57-49f2-8fe9-4a456c023a53,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:10.255206 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:10.381006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:10.394581 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:10.406745 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:10.407709 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c340b20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:10.419237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.420727 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 4.8440051
Jun 02 16:41:10.423675 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50662) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:10.461025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.467787 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:10.599772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2484edd2-95f7-4980-82d6-89c935f0638c req-5e638948-4cc7-4dcb-9890-7cdf61d8fda0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:10.608101 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2484edd2-95f7-4980-82d6-89c935f0638c req-5e638948-4cc7-4dcb-9890-7cdf61d8fda0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2608914
Jun 02 16:41:10.635118 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ca8cd98d-c3e8-45ac-8780-59a7fe077750,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:10.641403 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:10.658023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:10.658422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Network hostable DHCP agents. Network: 00fea91a-5ad9-4ee8-ae53-59f9858b59ca, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:41:10.682213 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2484edd2-95f7-4980-82d6-89c935f0638c req-334fa882-0fed-4548-a6bd-f22ebe5f23f9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730855
Jun 02 16:41:10.696822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:41:10.736301 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 00fea91a-5ad9-4ee8-ae53-59f9858b59ca) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:10.744503 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0199a1dc-aa7c-44a8-9741-5b70ede7572a None None] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:10.768576 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:10.772109 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:10.777007 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:10.819986 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.0806015
Jun 02 16:41:10.829125 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50670) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:10.840017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:10.844887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:10.941482 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cd1e177e-3a3b-476a-af4f-418f24c910fa req-b15f30ed-2496-41a9-915d-e21b358a5140 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.1183858
Jun 02 16:41:10.946217 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Usage tracker for resource:router and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:10.953154 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:11.019277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:11.087111 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:11.088239 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:11.166235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-fdc08bb4-dd7a-4646-ba29-df9ae76b6b83 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:11.167735 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-fdc08bb4-dd7a-4646-ba29-df9ae76b6b83 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 808 time: 0.4639215
Jun 02 16:41:11.214163 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Request body: {'port': {'device_id': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f', 'admin_state_up': True, 'tenant_id': 'a1836d0c3dbd473ca08d38562b52e19d'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:11.266057 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-70f3be10-e482-41bb-8da7-84a8aaa6a877 req-0f5469b7-19e5-4e6f-b3cf-be10bd20ab49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.0773849
Jun 02 16:41:11.293825 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:11.346830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:41:11.349490 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:11.583175 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c340b20>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:08Z', 'revision_number': 3, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:11.589714 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:11.590403 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Updating router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb port 8718120d-fc7a-424e-a11d-097b4d3a57d0 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:11.650748 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Allocated IP 172.20.0.2 (00fea91a-5ad9-4ee8-ae53-59f9858b59ca/ca8cd98d-c3e8-45ac-8780-59a7fe077750/00a534d8-55b3-4d1f-8291-a45a4debf37e) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:11.683298 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e8e6a355-ea57-49f2-8fe9-4a456c023a53 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:11.688555 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:11.746364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-6e354160-ef08-4c87-b0b1-8f8661e50963 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:11.747938 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-6e354160-ef08-4c87-b0b1-8f8661e50963 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.3628304
Jun 02 16:41:11.764547 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Request body: {'port': {'device_id': 'b6486b72-9943-4916-9659-063dbbeef979', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'admin_state_up': True, 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:12.008721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:12.034534 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:12.067420 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:12.071358 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.086485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:12.092257 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Usage tracker for resource:port and tenant:a1836d0c3dbd473ca08d38562b52e19d is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:12.095864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:12.103640 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port e8e6a355-ea57-49f2-8fe9-4a456c023a53 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:12.104235 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.104946 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:12.298107 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Made reservation on behalf of a1836d0c3dbd473ca08d38562b52e19d for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:12.301591 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.392605 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.406180 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Transition to ACTIVE for port object 8718120d-fc7a-424e-a11d-097b4d3a57d0 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:12.418633 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.418869 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.424857 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:12.435800 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Transition to ACTIVE for port object 00a534d8-55b3-4d1f-8291-a45a4debf37e will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:12.473414 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Transition to ACTIVE for port object 00a534d8-55b3-4d1f-8291-a45a4debf37e will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:12.484627 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.490250 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:12.502178 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-464e845c-f8ab-4fdb-acc8-73fc1f676fe9 req-53e4f0fa-09e1-4370-861e-ebaac85eabd4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0568230
Jun 02 16:41:12.524582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Allocated IP 172.20.0.2 (87543dfa-9cef-40b2-b537-1f95fcf2b066/409c7043-b3b6-42f7-90b5-f7db5d717e70/25af827a-b3ac-4754-ac1f-451d6179e2f4) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:12.592821 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:12.593027 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Pushing event updated for resources: {'Port': ['ID=8718120d-fc7a-424e-a11d-097b4d3a57d0,revision_number=2']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:12.596097 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:12.600664 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:12.612107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Pushing event updated for resources: {'Port': ['ID=00a534d8-55b3-4d1f-8291-a45a4debf37e,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:12.614468 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.614814 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.615193 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.615525 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.615909 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.616279 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.616602 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.616921 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.617305 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.617635 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.618008 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.618495 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:12.626622 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Attempting to bind port 8718120d-fc7a-424e-a11d-097b4d3a57d0 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:12.626927 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Attempting to bind port 8718120d-fc7a-424e-a11d-097b4d3a57d0 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:12.627196 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Attempting to bind port 8718120d-fc7a-424e-a11d-097b4d3a57d0 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:12.633513 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:12.634389 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:12.634763 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:12.635164 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.635551 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:12.636087 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Bound port: 8718120d-fc7a-424e-a11d-097b4d3a57d0, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:12.636460 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.662885 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:12.736768 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Attempting to bind port 00a534d8-55b3-4d1f-8291-a45a4debf37e on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:12.737443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Attempting to bind port 00a534d8-55b3-4d1f-8291-a45a4debf37e by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:12.738145 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Attempting to bind port 00a534d8-55b3-4d1f-8291-a45a4debf37e on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:12.744894 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:12.745640 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:12.746195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.746730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Bound using segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:12.747645 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Bound port: 00a534d8-55b3-4d1f-8291-a45a4debf37e, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:12.748212 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.750878 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] For port 8718120d-fc7a-424e-a11d-097b4d3a57d0, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:12.756534 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.764632 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] For port 8718120d-fc7a-424e-a11d-097b4d3a57d0, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=8718120d-fc7a-424e-a11d-097b4d3a57d0,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:12.778767 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.800156 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:12.826787 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-28226135-db4c-48a9-96ba-e3ec6e1d0c82 req-878c072b-1663-434d-9895-1db4da43ebbc tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.0650995
Jun 02 16:41:12.889644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] For port 00a534d8-55b3-4d1f-8291-a45a4debf37e, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:12.892264 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.894035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] For port 00a534d8-55b3-4d1f-8291-a45a4debf37e, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=00a534d8-55b3-4d1f-8291-a45a4debf37e,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:12.902643 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.914313 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7879264f-261e-4ed7-9576-a74222725b52 req-86689776-5cec-4008-ab30-3d1c54ab9571 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:12.915811 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7879264f-261e-4ed7-9576-a74222725b52 req-86689776-5cec-4008-ab30-3d1c54ab9571 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1099 time: 1.1612287
Jun 02 16:41:12.918084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:12.934788 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:12.940578 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:12.941225 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c340b20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:12.945887 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:12.963095 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3', 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:13.068008 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:13.078321 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:13.086515 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:13.104511 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Pushing event updated for resources: {'Port': ['ID=8718120d-fc7a-424e-a11d-097b4d3a57d0,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:13.109467 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Pushing event updated for resources: {'Port': ['ID=00a534d8-55b3-4d1f-8291-a45a4debf37e,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:13.115323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Allocated IP 172.20.0.3 (02df58b0-f30e-4a68-b09a-14d590111b4f/20e402a0-b7ee-4669-88f8-ad03a86eca35/2b18f1d1-11cc-40ea-818e-7eb8d8c14435) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:13.117892 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:13.119351 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:13.158501 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event updated for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:13.163907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:13.182883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:13.183686 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:13.222488 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4639204
Jun 02 16:41:13.238133 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Request body: {'port': {'device_id': 'b6486b72-9943-4916-9659-063dbbeef979', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:13.254656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b3aee8b-9b2a-4c0c-baad-15630d98b717 req-8169a4a3-0fbc-4df5-904d-7ee4d131a519 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:13.262699 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2b3aee8b-9b2a-4c0c-baad-15630d98b717 req-8169a4a3-0fbc-4df5-904d-7ee4d131a519 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 1.1461840
Jun 02 16:41:13.355864 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:13.427278 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7879264f-261e-4ed7-9576-a74222725b52 req-2c495872-d05f-4bcd-8af1-77f379b1de10 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2821593
Jun 02 16:41:13.597819 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2b3aee8b-9b2a-4c0c-baad-15630d98b717 req-a6a21375-1b39-43b3-8022-6cbe0bd572c4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3308172
Jun 02 16:41:13.687698 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:13.792498 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:13.818789 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 00a534d8-55b3-4d1f-8291-a45a4debf37e up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:13.950218 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c340b20>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:08Z', 'revision_number': 3, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:13.954647 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f070816c-97af-4ada-8ff8-528b75cf2645 None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:08Z', 'revision_number': 3, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:13.967965 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 00a534d8-55b3-4d1f-8291-a45a4debf37e completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:14.219452 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6232989e-b25f-445b-a0aa-ecffbb49b2c3 req-337109f1-10fc-4413-885f-c22c2cd1cc5b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.1630340
Jun 02 16:41:14.260125 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79a0155-d2c2-4516-9682-962eedc888ff req-28c5c719-812d-4ca5-9fab-7cbab370c5fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:14.261647 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-d79a0155-d2c2-4516-9682-962eedc888ff req-28c5c719-812d-4ca5-9fab-7cbab370c5fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:14.294810 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.352651 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-d79a0155-d2c2-4516-9682-962eedc888ff req-28c5c719-812d-4ca5-9fab-7cbab370c5fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:14.360039 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d79a0155-d2c2-4516-9682-962eedc888ff req-28c5c719-812d-4ca5-9fab-7cbab370c5fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 931 time: 0.4307311
Jun 02 16:41:14.563376 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d79a0155-d2c2-4516-9682-962eedc888ff req-c7a713cf-88d8-4493-838c-99af9d2685d6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1992731
Jun 02 16:41:14.596526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.613705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 25af827a-b3ac-4754-ac1f-451d6179e2f4 {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:14.631433 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.667769 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Transition to ACTIVE for port object 25af827a-b3ac-4754-ac1f-451d6179e2f4 will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:14.675887 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.694260 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692d60f0-3f8f-4934-9350-16a3c97ecbfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:14.716329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.759254 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:14.762432 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9113301d-0c5f-4da5-9aec-1720ed90f12a None None] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:14.899944 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Provisioning for port 00a534d8-55b3-4d1f-8291-a45a4debf37e completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:14.917698 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Provisioning complete for port 00a534d8-55b3-4d1f-8291-a45a4debf37e triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:14.918394 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:14.962936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Pushing event updated for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:14.985665 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:14.986960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.073216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c6d98b-e87e-4573-a8f2-3ee45f0b9c84 req-c1e6f913-f662-4602-a6c9-4714490b8072 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:15.075291 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-44c6d98b-e87e-4573-a8f2-3ee45f0b9c84 req-c1e6f913-f662-4602-a6c9-4714490b8072 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.2646353
Jun 02 16:41:15.133513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Network 02df58b0-f30e-4a68-b09a-14d590111b4f is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:15.139135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Attempting to bind port 25af827a-b3ac-4754-ac1f-451d6179e2f4 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:15.140382 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Attempting to bind port 25af827a-b3ac-4754-ac1f-451d6179e2f4 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:15.140557 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Attempting to bind port 25af827a-b3ac-4754-ac1f-451d6179e2f4 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:15.148769 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Port 25af827a-b3ac-4754-ac1f-451d6179e2f4 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:15.149082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Attempting to bind port 25af827a-b3ac-4754-ac1f-451d6179e2f4 on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:15.153336 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:15.155672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Pushing event updated for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:15.158065 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:15.158408 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Checking segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:15.158791 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Bound using segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:15.159239 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Bound port: 25af827a-b3ac-4754-ac1f-451d6179e2f4, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:15.159586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.166774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:15.182712 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-44c6d98b-e87e-4573-a8f2-3ee45f0b9c84 req-ae673813-9ed4-42e5-b03f-4a14349c41ce tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0966611
Jun 02 16:41:15.242103 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.483s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:15.285028 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Allocated IP 172.20.0.1 (715517d1-0353-4b9d-972e-92eb6241fe32/200a3016-0d3b-4aef-b80d-de65cae94521/6cba9a0d-4163-4759-a776-8a3a131c3f51) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:15.323798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:15.325910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.385344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.428552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] For port 00a534d8-55b3-4d1f-8291-a45a4debf37e, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=00a534d8-55b3-4d1f-8291-a45a4debf37e,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:15.436609 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.440239 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:15.537201 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Pushing event updated for resources: {'Port': ['ID=00a534d8-55b3-4d1f-8291-a45a4debf37e,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:15.540794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:15.627513 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.4231153
Jun 02 16:41:15.651190 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Request body: {'port': {'device_id': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:15.656539 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:15.674385 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:15.686810 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.703178 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8992d440-c4b5-482c-917c-589fcc97a26f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:15.736552 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Allocated IP 172.27.0.220 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/1af8e635-677a-4e1c-8a16-c74d2ec4a2cf) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:15.772505 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd2a176-cc4d-4b7f-87c5-74d6f72301ad req-e0d14475-27d7-4933-8653-3bcd000936f7 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:15.774008 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6fd2a176-cc4d-4b7f-87c5-74d6f72301ad req-e0d14475-27d7-4933-8653-3bcd000936f7 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 931 time: 0.1979475
Jun 02 16:41:15.787330 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:15.787946 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.789344 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] 10.222.0.20 "PUT /v2.0/ports/25af827a-b3ac-4754-ac1f-451d6179e2f4 HTTP/1.1" status: 200  len: 1093 time: 2.5565498
Jun 02 16:41:15.789878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:15.798935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-381e37f4-4dd1-4b90-8df0-979794103261" -d '{"events": [{"name": "network-changed", "server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:15.825725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.844009 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 00a534d8-55b3-4d1f-8291-a45a4debf37e up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:15.864653 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Pushing event updated for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:15.869629 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:15.872094 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-6fd2a176-cc4d-4b7f-87c5-74d6f72301ad req-c271fe40-b875-4bfa-879e-331be568bb27 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:15.896803 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-6fd2a176-cc4d-4b7f-87c5-74d6f72301ad req-c271fe40-b875-4bfa-879e-331be568bb27 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:15.898048 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6fd2a176-cc4d-4b7f-87c5-74d6f72301ad req-c271fe40-b875-4bfa-879e-331be568bb27 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0951240
Jun 02 16:41:15.914477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Transition to ACTIVE for port object 6cba9a0d-4163-4759-a776-8a3a131c3f51 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:15.943730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fd3197b6-72cb-425b-abd9-d765ae05fc12 None None] Provisioning complete for port 00a534d8-55b3-4d1f-8291-a45a4debf37e triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:15.944788 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fd3197b6-72cb-425b-abd9-d765ae05fc12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:15.959354 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5540a7a1-44dd-4a22-bc65-e1c6e5f9746a req-f60804b9-acb9-4ea3-bab1-6d6801833a2a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:15.966528 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5540a7a1-44dd-4a22-bc65-e1c6e5f9746a req-f60804b9-acb9-4ea3-bab1-6d6801833a2a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.5223339
Jun 02 16:41:16.029843 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 00a534d8-55b3-4d1f-8291-a45a4debf37e triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:16.030631 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.075362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.098655 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9e574a-083a-4004-9ef9-2aa10ca18787 req-08fbb3fd-dca3-41cd-bab3-26783d999c24 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:16.100641 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2a9e574a-083a-4004-9ef9-2aa10ca18787 req-08fbb3fd-dca3-41cd-bab3-26783d999c24 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 943 time: 0.0939634
Jun 02 16:41:16.119278 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5540a7a1-44dd-4a22-bc65-e1c6e5f9746a req-913d14bf-a744-42bb-af32-6ddada24db44 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1517847
Jun 02 16:41:16.171981 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2a9e574a-083a-4004-9ef9-2aa10ca18787 req-cbb84298-fb4e-406e-8bbb-926a74547791 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0628417
Jun 02 16:41:16.213937 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.240297 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:16.244713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e48d0bc6-a4af-42aa-a7e9-a4624ebc57f1 x-openstack-request-id: req-e48d0bc6-a4af-42aa-a7e9-a4624ebc57f1 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:16.245025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:16.245326 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-e48d0bc6-a4af-42aa-a7e9-a4624ebc57f1 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:16.245784 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4', 'status': 'completed', 'code': 200}
Jun 02 16:41:16.287315 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 8718120d-fc7a-424e-a11d-097b4d3a57d0 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:16.288466 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.375106 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:16.382830 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:16.399104 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:16.412303 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 8718120d-fc7a-424e-a11d-097b4d3a57d0 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:16.419227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 8718120d-fc7a-424e-a11d-097b4d3a57d0 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:16.419661 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.437865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Pushing event updated for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:16.449951 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:16.512338 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.546340 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:16.562990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.586277 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 8718120d-fc7a-424e-a11d-097b4d3a57d0, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=8718120d-fc7a-424e-a11d-097b4d3a57d0,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:16.594405 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.602841 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:16.605106 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.690428 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=8718120d-fc7a-424e-a11d-097b4d3a57d0,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:16.695173 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:16.696951 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e09c21fb-9c28-40f6-9348-904a1e37172c None None] Provisioning for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:16.704738 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e09c21fb-9c28-40f6-9348-904a1e37172c None None] Provisioning complete for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:16.705211 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e09c21fb-9c28-40f6-9348-904a1e37172c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:16.718952 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:16.724917 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:16.734890 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:16.794857 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-e09c21fb-9c28-40f6-9348-904a1e37172c None None] Port 6cba9a0d-4163-4759-a776-8a3a131c3f51 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:16.803598 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Pushing event updated for resources: {'Port': ['ID=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:16.815910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:17.087740 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeb3471-771e-41a3-9223-09afdcfc68ca req-5bef4e15-e37b-44a0-88d4-f19631c4c6c3 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:17.089223 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5aeb3471-771e-41a3-9223-09afdcfc68ca req-5bef4e15-e37b-44a0-88d4-f19631c4c6c3 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 931 time: 0.0825686
Jun 02 16:41:17.136279 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5aeb3471-771e-41a3-9223-09afdcfc68ca req-1f0e5ffd-5457-4276-ae1c-e4acb43cfe41 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409954
Jun 02 16:41:17.230463 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:17.240646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:17.368934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Transition to ACTIVE for port object 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:17.370963 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c130ba9e-bbb1-4f66-9aa8-140feb045c9e req-b7077ab0-43de-451f-8db8-9d1f8a69bb2f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:17.372545 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c130ba9e-bbb1-4f66-9aa8-140feb045c9e req-b7077ab0-43de-451f-8db8-9d1f8a69bb2f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 943 time: 0.0887074
Jun 02 16:41:17.405263 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:17.414182 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-53391cae-61de-49f7-9aca-566afdac3c2d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:17.423229 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c130ba9e-bbb1-4f66-9aa8-140feb045c9e req-811c6387-19c2-47db-9eca-d671f5dc0352 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406969
Jun 02 16:41:17.474559 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:17.600573 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 8718120d-fc7a-424e-a11d-097b4d3a57d0 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:17.665423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Pushing event updated for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:17.671400 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 8718120d-fc7a-424e-a11d-097b4d3a57d0 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:17.671751 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:17.708059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:17.767305 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.057146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Attempting to bind port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:18.057452 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Attempting to bind port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:18.057818 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Attempting to bind port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 on network 02df58b0-f30e-4a68-b09a-14d590111b4f {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:18.079759 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 on network 02df58b0-f30e-4a68-b09a-14d590111b4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:18.080025 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Attempting to bind port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 on network 02df58b0-f30e-4a68-b09a-14d590111b4f {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:18.156762 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:18.157064 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Checking segment: {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:18.157461 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Bound using segment: {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:18.157924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Bound port: 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:18.158264 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.326024 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.330183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf19890-fe52-44fd-9d18-f4c0738c49ce req-f4c00aee-6c82-468e-9123-804b489502ab tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:18.331848 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2cf19890-fe52-44fd-9d18-f4c0738c49ce req-f4c00aee-6c82-468e-9123-804b489502ab tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 943 time: 0.0875926
Jun 02 16:41:18.347214 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.384122 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:18.386390 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2cf19890-fe52-44fd-9d18-f4c0738c49ce req-90ecdc6e-8d86-4507-ab90-c00bf2d57310 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473540
Jun 02 16:41:18.455223 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.579542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:18.633007 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381e37f4-4dd1-4b90-8df0-979794103261 req-81f66c04-9673-4cf8-9c5a-ada415b5ae30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:18.634482 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-381e37f4-4dd1-4b90-8df0-979794103261 req-81f66c04-9673-4cf8-9c5a-ada415b5ae30 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 1096 time: 0.1450877
Jun 02 16:41:18.649770 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30371337-1c12-4a95-af7e-4b80622178c7 req-601ad128-7484-4a9f-aca5-d4af9027dba9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:18.651179 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-30371337-1c12-4a95-af7e-4b80622178c7 req-601ad128-7484-4a9f-aca5-d4af9027dba9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 943 time: 0.1043973
Jun 02 16:41:18.665561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:18.666894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.674103 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Pushing event updated for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:18.681222 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.685973 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:18.686496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:18.804626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:18.805304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:18.805962 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-30371337-1c12-4a95-af7e-4b80622178c7 req-a78f8382-26a8-4559-bfb2-cf397af85b56 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1313107
Jun 02 16:41:18.806635 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] 10.222.0.20 "PUT /v2.0/ports/2b18f1d1-11cc-40ea-818e-7eb8d8c14435 HTTP/1.1" status: 200  len: 1093 time: 3.1608388
Jun 02 16:41:18.843251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381e37f4-4dd1-4b90-8df0-979794103261 req-4a43cc33-68d6-4e80-864c-8751981c920f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:18.844724 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-381e37f4-4dd1-4b90-8df0-979794103261 req-4a43cc33-68d6-4e80-864c-8751981c920f service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=a3af7d82fba84269a3596d85213ae5e2&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1926832
Jun 02 16:41:18.861271 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:18.863798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1" -d '{"events": [{"name": "network-changed", "server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:18.927529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f755054-8f8c-4763-aece-c7f57eb3d094 x-openstack-request-id: req-0f755054-8f8c-4763-aece-c7f57eb3d094 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:18.927826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:18.928103 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0f755054-8f8c-4763-aece-c7f57eb3d094 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:18.928511 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435', 'status': 'completed', 'code': 200}
Jun 02 16:41:18.987891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Pushing event updated for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:19.009966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:19.025550 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381e37f4-4dd1-4b90-8df0-979794103261 req-b440f1c2-a485-4b0e-9440-c8f63393f503 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.027262 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-381e37f4-4dd1-4b90-8df0-979794103261 req-b440f1c2-a485-4b0e-9440-c8f63393f503 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1604037
Jun 02 16:41:19.079668 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:19.087354 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:19.184472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-01038b5b-36bf-4bdd-8782-25abdb7883f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.186539 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-01038b5b-36bf-4bdd-8782-25abdb7883f2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 1096 time: 0.2629521
Jun 02 16:41:19.193233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98277) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:41:19.233048 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-2854253b-5776-4a42-abbd-bed196bd15b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.234635 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-2854253b-5776-4a42-abbd-bed196bd15b6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 1096 time: 0.1576962
Jun 02 16:41:19.389725 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-1216cecf-87ab-40f1-8547-c9f17661d057 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4 HTTP/1.1" status: 200  len: 217 time: 0.1417198
Jun 02 16:41:19.401792 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-c4fbafe5-f2ce-412f-ac5d-ab25c130d86b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435 HTTP/1.1" status: 200  len: 217 time: 0.2024629
Jun 02 16:41:19.455948 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-2fc84956-5cc5-4526-b7ee-06a89cc19b4f None None] Provisioning complete for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:19.457210 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-2fc84956-5cc5-4526-b7ee-06a89cc19b4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:19.475255 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-bbdc04d4-7187-4d3d-937c-b4346c045b86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.477063 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-bbdc04d4-7187-4d3d-937c-b4346c045b86 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.0724978
Jun 02 16:41:19.536429 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-2fc84956-5cc5-4526-b7ee-06a89cc19b4f None None] Port 6cba9a0d-4163-4759-a776-8a3a131c3f51 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:19.598870 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-edbb7566-7696-4b82-ab29-c22de8d5b710 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1125858
Jun 02 16:41:19.675037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:41:19.739426 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b63cf9-9563-4082-8cc3-84d3fbe379a7 req-6d301791-039c-49a6-854a-2afa47f37e49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.741141 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b63cf9-9563-4082-8cc3-84d3fbe379a7 req-6d301791-039c-49a6-854a-2afa47f37e49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 943 time: 0.1974454
Jun 02 16:41:19.754809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-b96835cc-d0a5-4715-8b30-55c083e4d50d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.756341 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-b96835cc-d0a5-4715-8b30-55c083e4d50d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=20e402a0-b7ee-4669-88f8-ad03a86eca35 HTTP/1.1" status: 200  len: 848 time: 0.2976751
Jun 02 16:41:19.779759 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-10a9c4d6-d685-4414-b24d-c28f83cb3415 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1731122
Jun 02 16:41:19.824031 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b63cf9-9563-4082-8cc3-84d3fbe379a7 req-5414efd8-3cbd-40bd-bd38-6c98bab6f7ff tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0704703
Jun 02 16:41:19.909745 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-77657b39-de3e-493c-9c8d-71ada262fb68 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=02df58b0-f30e-4a68-b09a-14d590111b4f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1314025
Jun 02 16:41:19.948917 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcadc24-482a-4697-986f-476b02020015 req-496cb4ca-e7e2-406f-a06d-7874d740b983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:19.950549 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-496cb4ca-e7e2-406f-a06d-7874d740b983 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.5384598
Jun 02 16:41:19.951577 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:19.963203 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:19.975603 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:19.976857 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43550>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:20.019890 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-082bc6c0-1cd3-4adb-b179-d45dc3ef091c req-1b1a8d25-021a-4218-be6e-cdb59be002ed service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2295852
Jun 02 16:41:20.219752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd89353f-23b0-4eb9-be11-afadf4a18bb4 req-9d7ec94d-27b4-444e-a2bf-288e581810ba tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:20.220184 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cd89353f-23b0-4eb9-be11-afadf4a18bb4 req-9d7ec94d-27b4-444e-a2bf-288e581810ba tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 943 time: 0.1071169
Jun 02 16:41:20.262379 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:20.287337 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cd89353f-23b0-4eb9-be11-afadf4a18bb4 req-d7fdd252-db6a-4d85-83c9-ad9f0c63f65f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0588620
Jun 02 16:41:20.313579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:20.314823 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 9.4840741
Jun 02 16:41:20.317915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50812) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:20.361504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6e447c-b646-4b8f-b10c-f8938eebf326 req-ceb99aa5-0d8c-4940-aa04-b588e6a21dcc tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:20.370108 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b6e447c-b646-4b8f-b10c-f8938eebf326 req-ceb99aa5-0d8c-4940-aa04-b588e6a21dcc tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.8109286
Jun 02 16:41:20.518353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:20.528707 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:20.543045 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:20.544070 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c02d3d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:20.552505 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] 10.222.0.25 "PUT /v2.0/routers/c5c2afbf-baf8-419d-a314-8b5a4e00c5fb/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.1273522
Jun 02 16:41:20.668466 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-f4bcc508-156d-4239-932c-904c6123b92a service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7463758
Jun 02 16:41:20.697086 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b6e447c-b646-4b8f-b10c-f8938eebf326 req-90e2295b-7e61-4d5f-9c3b-beb6be6ee2b0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3259799
Jun 02 16:41:20.701135 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43550>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 3, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:20.713165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:20.716768 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Updating router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:20.825216 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcadc24-482a-4697-986f-476b02020015 req-bed2384f-c3e7-43d1-9e08-7873c58a9344 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:20.829944 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-bed2384f-c3e7-43d1-9e08-7873c58a9344 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.8560498
Jun 02 16:41:20.874254 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:20.898032 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.085759 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50830) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:21.183408 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-8cefb51f-e793-4f6f-818d-428c8f4b2b64 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.3309989
Jun 02 16:41:21.356640 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c02d3d0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 2, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:21.371282 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:21.371499 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.371623 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Updating router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb port 6cba9a0d-4163-4759-a776-8a3a131c3f51 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:21.390858 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8a42f8a1-501b-425d-8973-741bb0f21681 req-0b5a09d8-262d-4e85-8780-9f0724afedab service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6924040
Jun 02 16:41:21.394674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:21.405642 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Usage tracker for resource:security_group_rule and tenant:cc2fb0211b37470ea6fe6473d564120d is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:21.415159 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:21.415669 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcadc24-482a-4697-986f-476b02020015 req-e78bf302-fbad-436e-91e3-4e59f403d0c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:21.417156 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-e78bf302-fbad-436e-91e3-4e59f403d0c0 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.2101576
Jun 02 16:41:21.428198 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:21.448258 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.470514 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.612815 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-ca7ed0f1-924d-4335-b744-8d9f88bf1916 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1761749
Jun 02 16:41:21.638029 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f644ea-7d8f-4649-ac66-0e16242dd334 req-20ce9395-cc42-4c31-99bd-d61903520c97 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:21.638788 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-18f644ea-7d8f-4649-ac66-0e16242dd334 req-20ce9395-cc42-4c31-99bd-d61903520c97 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:21.745343 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.773419 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50842) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:21.797435 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1348393065', 'description': 'tempest-description--506086445'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:21.820964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Allocated IP 172.20.0.1 (00fea91a-5ad9-4ee8-ae53-59f9858b59ca/ca8cd98d-c3e8-45ac-8780-59a7fe077750/a136648f-8d38-4ebc-9c83-dec23c8c9621) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:21.827226 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:21.880165 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.893014 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-18f644ea-7d8f-4649-ac66-0e16242dd334 req-20ce9395-cc42-4c31-99bd-d61903520c97 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:21.899397 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18f644ea-7d8f-4649-ac66-0e16242dd334 req-20ce9395-cc42-4c31-99bd-d61903520c97 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 943 time: 0.7996194
Jun 02 16:41:21.907341 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Transition to ACTIVE for port object 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:21.921777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:21.922830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:21.930833 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:21.937549 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:21.944342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:22.004282 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18f644ea-7d8f-4649-ac66-0e16242dd334 req-828aac76-e6f0-4e1a-bd33-edec9b1c7013 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1038961
Jun 02 16:41:22.051934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.105981 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Attempting to bind port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:22.106435 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Attempting to bind port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:22.106935 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Attempting to bind port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:22.107620 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-3f823319-764e-42df-ad25-6d9d36596329 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4641435
Jun 02 16:41:22.108507 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.110617 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-49308200-9c72-40c2-acf3-cb5947c157e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:22.116535 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-49308200-9c72-40c2-acf3-cb5947c157e4 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 1096 time: 0.6180947
Jun 02 16:41:22.121061 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:22.121440 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:22.121867 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.122258 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:22.123197 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Bound port: 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:22.123630 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.139227 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Transition to ACTIVE for port object 6cba9a0d-4163-4759-a776-8a3a131c3f51 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:22.154438 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.157701 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.174433 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:22.178645 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-024f6881-e4ab-48c3-946f-a98a7a914a57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:22.220461 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Pushing event updated for resources: {'Port': ['ID=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.230454 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:22.273976 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:22.292308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] For port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:22.300969 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] For port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:22.313661 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.313879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:22.317431 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:22.324801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.351323 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=cc2fb0211b37470ea6fe6473d564120d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2638452
Jun 02 16:41:22.359798 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50848) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:22.402137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:22.419324 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b2307d8-70d4-4a00-ae7f-abe3f3a4d387,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.423007 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:22.429303 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Transition to ACTIVE for port object a136648f-8d38-4ebc-9c83-dec23c8c9621 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:22.478800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.483177 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:22.483838 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43550>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:22.508257 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c62102bb-f6df-45fe-8332-86366903acd7 req-a762c591-7ca3-4618-9f6c-ecdaa482f46e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:22.509867 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c62102bb-f6df-45fe-8332-86366903acd7 req-a762c591-7ca3-4618-9f6c-ecdaa482f46e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 943 time: 0.2562208
Jun 02 16:41:22.521521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:22.535329 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe7a8f94-8497-472d-a1c8-4dea1c2715ca None None] Pushing event updated for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.598243 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 25af827a-b3ac-4754-ac1f-451d6179e2f4 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:41:22.598739 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-8497-472d-a1c8-4dea1c2715ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:22.626017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Pushing event updated for resources: {'Port': ['ID=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.642501 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dcadc24-482a-4697-986f-476b02020015 req-2aed4e8e-aa45-450f-958b-8a67c50fc742 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5247016
Jun 02 16:41:22.644213 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:22.657183 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-942cf2e5-491c-4d4e-b791-6fe6cbc0e503 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:22.658702 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-942cf2e5-491c-4d4e-b791-6fe6cbc0e503 service neutron] 10.222.0.20 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 909 time: 0.4903450
Jun 02 16:41:22.692950 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:41:22.731083 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.748129 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.768320 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:22.773435 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Attempting to bind port 6cba9a0d-4163-4759-a776-8a3a131c3f51 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:22.774817 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Attempting to bind port 6cba9a0d-4163-4759-a776-8a3a131c3f51 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:22.777211 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Attempting to bind port 6cba9a0d-4163-4759-a776-8a3a131c3f51 on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:22.797717 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 40, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:22.798116 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Checking segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:22.798573 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.798966 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Bound using segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:22.799437 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Bound port: 6cba9a0d-4163-4759-a776-8a3a131c3f51, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:22.799823 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.858592 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c62102bb-f6df-45fe-8332-86366903acd7 req-7fac6802-fd23-4f25-8ab7-9a5af7ba5d51 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3369823
Jun 02 16:41:22.869876 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:22.875769 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:22.878994 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:22.919594 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Pushing event updated for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.923773 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:22.951679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.953677 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-83b38353-7e2c-4167-b80a-d13a64d5f712 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435 HTTP/1.1" status: 200  len: 217 time: 0.2869310
Jun 02 16:41:22.954918 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] For port 6cba9a0d-4163-4759-a776-8a3a131c3f51, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:22.960836 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] For port 6cba9a0d-4163-4759-a776-8a3a131c3f51, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=6cba9a0d-4163-4759-a776-8a3a131c3f51,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:22.966915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.969349 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:22.973321 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b3080572-6f6d-4bb3-9192-b934cf201154 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:22.990907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b2307d8-70d4-4a00-ae7f-abe3f3a4d387,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:22.993293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:23.000750 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-ca447a88-bf0c-4600-a9fe-08e4f2c12270 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:23.015263 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32701b3b-e59a-4899-87a3-cce38f5638b9 req-81b01428-3c37-40c5-a0d3-373b953e2f05 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:23.015635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.019090 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4b2307d8-70d4-4a00-ae7f-abe3f3a4d387 HTTP/1.1" status: 204  len: 168 time: 0.6532905
Jun 02 16:41:23.028990 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32701b3b-e59a-4899-87a3-cce38f5638b9 req-81b01428-3c37-40c5-a0d3-373b953e2f05 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.8022346
Jun 02 16:41:23.077885 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.099099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.112932 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:23.113473 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0a87196c-c57c-4d9d-9c60-6209c6cc78c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:23.168281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-9c2b952d-ada3-4eb2-a827-52ab75c4eb4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:23.170451 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-9c2b952d-ada3-4eb2-a827-52ab75c4eb4a service neutron] 10.222.0.20 "GET /v2.0/subnets?id=20e402a0-b7ee-4669-88f8-ad03a86eca35 HTTP/1.1" status: 200  len: 848 time: 0.2033956
Jun 02 16:41:23.185150 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32701b3b-e59a-4899-87a3-cce38f5638b9 req-ca7ef244-582a-4f2a-ac64-573481055264 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1548877
Jun 02 16:41:23.215416 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:23.227194 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c02d3d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:23.247490 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.366929 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-efffb59d-7d7c-462e-a127-e09317af1b4b service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=02df58b0-f30e-4a68-b09a-14d590111b4f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1739373
Jun 02 16:41:23.377059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.389279 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 1.6093514
Jun 02 16:41:23.392377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50868) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:23.454614 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group_rule': {'security_group_id': '82ded133-9206-48c1-9cff-f5d790937039', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:23.493177 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82ded133-9206-48c1-9cff-f5d790937039,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:23.500230 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:23.511660 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:23.521144 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:23.591389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:23.595271 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:23.602594 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:23.644239 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:23.760975 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.765541 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '25af827a-b3ac-4754-ac1f-451d6179e2f4', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'port_id': '25af827a-b3ac-4754-ac1f-451d6179e2f4', 'mac_address': 'fa:16:3e:7f:54:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 679, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '409c7043-b3b6-42f7-90b5-f7db5d717e70', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:41:23.766601 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50876) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:23.776943 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fff47055-cda0-4b2e-97a1-ec41046d8e16 None None] Provisioning for port a136648f-8d38-4ebc-9c83-dec23c8c9621 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:23.783922 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43550>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 3, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:23.790102 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-e75d65d7-fa89-4be6-b674-9e3bf5de5602 service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3963428
Jun 02 16:41:23.797126 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e24829f9-3230-448d-aa9e-8d5fd09c0eb0 None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 3, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:23.797707 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.832887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.838470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.855600 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.861546 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:23.862448 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe7a8f94-8497-472d-a1c8-4dea1c2715ca None None] Pushing event updated for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:23.869384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-fff47055-cda0-4b2e-97a1-ec41046d8e16 None None] Provisioning complete for port a136648f-8d38-4ebc-9c83-dec23c8c9621 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:23.869830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-fff47055-cda0-4b2e-97a1-ec41046d8e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.874520 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-8497-472d-a1c8-4dea1c2715ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.874s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:23.933396 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-fff47055-cda0-4b2e-97a1-ec41046d8e16 None None] Port a136648f-8d38-4ebc-9c83-dec23c8c9621 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:23.968538 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.969780 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 25af827a-b3ac-4754-ac1f-451d6179e2f4 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:23.975849 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:23.985684 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:23.988211 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Usage tracker for resource:security_group_rule and tenant:642b922a8d4f44759311923d1054b496 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:23.995857 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:23.997300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:24.012592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:24.059110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:24.073335 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.080444 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:24.102750 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.113525 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.117257 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.6858017
Jun 02 16:41:24.121326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50880) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:24.123649 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a4703814-4546-41a4-a50a-c5842db7b25f,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:24.133844 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group_rule': {'security_group_id': '82ded133-9206-48c1-9cff-f5d790937039', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:24.146004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:24.158099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:24.166996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:24.175437 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:24.189724 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f4a34e-cd9f-46df-88a8-02f24d5e5a19 req-d4f75f6f-149a-4ed7-85f4-3c816410886e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:24.198276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d7f4a34e-cd9f-46df-88a8-02f24d5e5a19 req-d4f75f6f-149a-4ed7-85f4-3c816410886e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 943 time: 0.7097030
Jun 02 16:41:24.208820 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:24.209499 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd0e4bb9-0f60-4e66-8a35-8efa26040ed1 req-bb43f209-13d4-455e-b858-42e30aed11fb service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4058397
Jun 02 16:41:24.256241 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c02d3d0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:22Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:24.262403 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f38e80d-aab2-4142-abca-fbf1641ee914 None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:22Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:24.297662 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.303185 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Pushing event updated for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:24.323108 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.465s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:24.328327 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d7f4a34e-cd9f-46df-88a8-02f24d5e5a19 req-b891447b-e6da-400f-b7f0-f3a355d58ba5 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1288798
Jun 02 16:41:24.331545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:24.336481 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:24.420706 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['25af827a-b3ac-4754-ac1f-451d6179e2f4'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:24.452485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.461960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.464509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:24.511006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31feb677-b527-40b4-91d6-75e9da57f80f,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:24.576168 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:24.583677 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:41:24.615621 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f915e13-a1b9-4c4e-a911-81b74b1623b4 req-75243597-db59-4679-b549-87f3d8ff21a3 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:24.615853 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.619972 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6f915e13-a1b9-4c4e-a911-81b74b1623b4 req-75243597-db59-4679-b549-87f3d8ff21a3 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 944 time: 0.5288610
Jun 02 16:41:24.622688 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4944663
Jun 02 16:41:24.623369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50886) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:24.628878 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:24.637547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:24.666116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:floatingip and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:24.673411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.676945 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:24.686768 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:24.694572 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:24.698755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.708417 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:24.723468 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bd53133c-9e9f-4e32-8055-245396bd074c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:24.733872 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:24.760090 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6f915e13-a1b9-4c4e-a911-81b74b1623b4 req-203d178d-e059-4b35-9beb-d6239a625d88 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1354234
Jun 02 16:41:24.828668 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6980ebdf-ebf2-4897-96d6-f8478bbd5c57 req-3af6b96c-4a08-4846-9601-a96809a13499 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:24.830486 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6980ebdf-ebf2-4897-96d6-f8478bbd5c57 req-3af6b96c-4a08-4846-9601-a96809a13499 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.3209670
Jun 02 16:41:24.907730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:24.954983 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435', 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f', 'port_id': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435', 'mac_address': 'fa:16:3e:3b:7a:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 654, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20e402a0-b7ee-4669-88f8-ad03a86eca35', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:41:24.961451 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e23276fa-9503-4878-93b6-b134e947a18d,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:24.982009 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6980ebdf-ebf2-4897-96d6-f8478bbd5c57 req-80c44529-c32a-45f8-ab70-d415671255f1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1357327
Jun 02 16:41:25.004725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:25.039442 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=642b922a8d4f44759311923d1054b496&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2659583
Jun 02 16:41:25.044926 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50894) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:25.125786 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.155569 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:25.180035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:25.194665 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.200509 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:25.229270 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.277319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-823cb07f-ccad-4237-9174-5b635676b318 None None] Provisioning complete for port a136648f-8d38-4ebc-9c83-dec23c8c9621 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:25.277919 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-823cb07f-ccad-4237-9174-5b635676b318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.281364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:41:25.424521 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:25.439212 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:25.453175 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-823cb07f-ccad-4237-9174-5b635676b318 None None] Port a136648f-8d38-4ebc-9c83-dec23c8c9621 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:25.506113 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.581909 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['2b18f1d1-11cc-40ea-818e-7eb8d8c14435'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:25.596439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Allocated IP 172.27.0.177 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/62d6149c-1b83-4c35-aa6e-01aa6947347a) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:25.663879 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.752478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:25.759966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1a635f-e56d-4bb4-ba58-a1e3baf0cc37 req-73d96025-16b6-44b6-a15f-92ba6a5ff28d tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:25.775793 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1b1a635f-e56d-4bb4-ba58-a1e3baf0cc37 req-73d96025-16b6-44b6-a15f-92ba6a5ff28d tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 944 time: 0.2414577
Jun 02 16:41:25.820437 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] 10.222.0.25 "PUT /v2.0/routers/8d9d514f-6911-4666-9f58-7dbc048e1ea3/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.4990108
Jun 02 16:41:25.842706 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 6cba9a0d-4163-4759-a776-8a3a131c3f51 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:25.856231 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.863195 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-cba4508d-2e7e-4dcb-9906-249d352590dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:25.871879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 50912) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:25.876727 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1b1a635f-e56d-4bb4-ba58-a1e3baf0cc37 req-53725e38-f2f5-41d4-898a-1b886f24dafe tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0894618
Jun 02 16:41:25.889330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.925483 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.926812 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e23276fa-9503-4878-93b6-b134e947a18d HTTP/1.1" status: 204  len: 168 time: 0.8741906
Jun 02 16:41:25.929199 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e23276fa-9503-4878-93b6-b134e947a18d,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:25.940263 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:25.949083 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:25.963949 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-982e4346-ef86-40a3-ad5a-9c0f36fb64b7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:26.033855 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:26.038254 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:26.038458 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-5ced3cd2-ca3c-4acc-881c-0248eceae56c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.042258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:26.130778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=62d6149c-1b83-4c35-aa6e-01aa6947347a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:26.134408 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:26.166847 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.189898 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:26.194925 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Usage tracker for resource:security_group_rule and tenant:0c66acf04a3a4313b1998d7c94afb796 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:26.198615 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:26.206385 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:26.255160 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:26.276568 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f00f05-7c5a-47a2-9988-b9100a3e316a req-7602aea4-636e-476e-9739-a74310039d46 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:26.280004 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71f00f05-7c5a-47a2-9988-b9100a3e316a req-7602aea4-636e-476e-9739-a74310039d46 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 944 time: 0.2309976
Jun 02 16:41:26.302204 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:26.302655 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.464613 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.481461 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.505014 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-71f00f05-7c5a-47a2-9988-b9100a3e316a req-66381f44-d87e-4e24-9bbf-a83ad9fd7a71 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2099476
Jun 02 16:41:26.596620 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 25af827a-b3ac-4754-ac1f-451d6179e2f4 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:26.643817 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.648751 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.655057 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:26.706512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 6cba9a0d-4163-4759-a776-8a3a131c3f51, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=6cba9a0d-4163-4759-a776-8a3a131c3f51,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:26.715451 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.716315 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:26.753936 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:26.797219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.828453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef857860-2777-4a10-bdd7-c3c3e1452e6b,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:26.828661 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 25af827a-b3ac-4754-ac1f-451d6179e2f4 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:26.831636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:26.844300 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0c66acf04a3a4313b1998d7c94afb796&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9710562
Jun 02 16:41:26.847172 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50942) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:26.854717 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c6b534-9caf-4099-943c-84e9845df252 req-375bf13b-6f55-479b-9cdd-098ed1821eca tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:26.856622 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-75c6b534-9caf-4099-943c-84e9845df252 req-375bf13b-6f55-479b-9cdd-098ed1821eca tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.5467746
Jun 02 16:41:26.888216 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:26.924512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 25af827a-b3ac-4754-ac1f-451d6179e2f4 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:26.926123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.948168 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-75c6b534-9caf-4099-943c-84e9845df252 req-3b7c9038-b71f-4e34-a951-1532e0d081ea tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0841825
Jun 02 16:41:26.956721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:26.986560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.031458 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:27.039181 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:27.040983 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50952) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:27.057691 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:27.058732 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c00c2b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:40:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:27.060725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-179469675-network', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:27.075306 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:27.079607 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Usage tracker for resource:network and tenant:1be1536c4ea0412a9c5fbd5dc1f04d9f is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:27.083267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:27.091340 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:27.115906 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Made reservation on behalf of 1be1536c4ea0412a9c5fbd5dc1f04d9f for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:27.118261 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.119266 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.125098 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.131454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:27.164867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.178755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4957deef-d003-49bf-8d36-23f8b7124de4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:27.183459 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:27.196229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef857860-2777-4a10-bdd7-c3c3e1452e6b,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:27.198577 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.213618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:27.225263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:27.225868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.235027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.236398 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ef857860-2777-4a10-bdd7-c3c3e1452e6b HTTP/1.1" status: 204  len: 168 time: 0.3880191
Jun 02 16:41:27.243923 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:27.270563 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Usage tracker for resource:security_group_rule and tenant:1be1536c4ea0412a9c5fbd5dc1f04d9f is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:27.277623 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:27.295670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:27.299646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=62d6149c-1b83-4c35-aa6e-01aa6947347a,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:27.308804 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.313831 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:27.351703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.361652 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.361857 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.7322078
Jun 02 16:41:27.361976 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94de111d-a458-4c8b-89a3-b883d8ad6b27 req-c3e0bd03-5067-4006-9b18-6ae1c26b952b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:27.363471 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-94de111d-a458-4c8b-89a3-b883d8ad6b27 req-c3e0bd03-5067-4006-9b18-6ae1c26b952b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 944 time: 0.2529421
Jun 02 16:41:27.426904 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:27.429203 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82ac6e2d-8dda-4236-b856-37010a9891b9" -d '{"events": [{"server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "name": "network-vif-plugged", "status": "completed", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:27.435717 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-94de111d-a458-4c8b-89a3-b883d8ad6b27 req-0a1c216a-c70b-4558-90e1-9f3f31911f95 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0636330
Jun 02 16:41:27.467620 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:27.541362 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.548132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.557044 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-129e0fce-e7a7-4648-b636-a9fd5a0fa3d3 x-openstack-request-id: req-129e0fce-e7a7-4648-b636-a9fd5a0fa3d3 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:27.557436 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "name": "network-vif-plugged", "status": "completed", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:27.557846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-129e0fce-e7a7-4648-b636-a9fd5a0fa3d3 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:27.558061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-727ae712-3931-43d2-ab04-b789c9972417 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:27.559290 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4', 'code': 200}
Jun 02 16:41:27.572644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:27.652515 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7694e2c-e734-448f-9bde-fbb59534dce7,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:27.656007 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] vlan segment allocate from pool success with {'vlan_id': 652, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:41:27.666131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.666477 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Added segment daa33d4f-6557-48f8-8364-408b98ddd67f of type vlan for network 2e981188-5c9f-4f7b-87dd-07a67b33db56
Jun 02 16:41:27.697131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.733735 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.739063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:27.778835 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:27.781838 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.783992 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:27.784573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.794841 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:27.874159 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-421173bc-710e-446d-868d-97a4221df7ee req-0ff041fb-d877-401d-b48f-f68f246eae0e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:27.910585 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-421173bc-710e-446d-868d-97a4221df7ee req-0ff041fb-d877-401d-b48f-f68f246eae0e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:27.911979 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-0ff041fb-d877-401d-b48f-f68f246eae0e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--1348393065&fields=id&tenant_id=5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 267 time: 0.1631212
Jun 02 16:41:27.929312 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Pushing event updated for resources: {'Network': ['ID=2e981188-5c9f-4f7b-87dd-07a67b33db56,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:27.939228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:27.944298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:27.953563 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:41:27.975768 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.9260719
Jun 02 16:41:27.982582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751eaf3c-bb60-406a-bb18-fea2346584e6 req-37870ca7-3318-4af7-ad00-bf386f4730f9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:27.994518 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-751eaf3c-bb60-406a-bb18-fea2346584e6 req-37870ca7-3318-4af7-ad00-bf386f4730f9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.2614691
Jun 02 16:41:27.994518 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 50992) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:28.012813 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Request body: {'subnet': {'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-179469675-subnet', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:28.020104 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:28.026646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Usage tracker for resource:subnet and tenant:1be1536c4ea0412a9c5fbd5dc1f04d9f is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:28.035738 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:28.049821 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:28.071898 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-751eaf3c-bb60-406a-bb18-fea2346584e6 req-dab94af2-358b-42de-bfb0-8cc720fa19e6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0790501
Jun 02 16:41:28.093082 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:28.104624 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Made reservation on behalf of 1be1536c4ea0412a9c5fbd5dc1f04d9f for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:28.108944 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.142300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-b56fca41-c1ab-4843-89c1-68b5a61b341d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:28.143834 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-b56fca41-c1ab-4843-89c1-68b5a61b341d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 811 time: 0.2214239
Jun 02 16:41:28.157025 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.418s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:28.169646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:28.176471 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-ea7574f6-1c08-4ad2-b20c-1cb86e59d7b3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/quotas/5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 375 time: 0.0202777
Jun 02 16:41:28.190862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.196516 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:28.264022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ce5245-e692-4e2d-9321-21e7059e70b9 req-21a81b9d-7071-454e-8234-05edac5fabeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:28.265547 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35ce5245-e692-4e2d-9321-21e7059e70b9 req-21a81b9d-7071-454e-8234-05edac5fabeb service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 1098 time: 0.4687760
Jun 02 16:41:28.313445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51002) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:28.348359 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 6cba9a0d-4163-4759-a776-8a3a131c3f51 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:28.416276 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:28.419161 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35ce5245-e692-4e2d-9321-21e7059e70b9 req-e3f056a2-d017-4179-8d56-b14e08a9a397 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1438031
Jun 02 16:41:28.423508 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:28.471552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 6cba9a0d-4163-4759-a776-8a3a131c3f51 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:28.471965 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.479294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-421173bc-710e-446d-868d-97a4221df7ee req-5ca2ab97-9dd1-4f02-bbe6-97239b4ea181 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:28.498287 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-421173bc-710e-446d-868d-97a4221df7ee req-5ca2ab97-9dd1-4f02-bbe6-97239b4ea181 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:28.499880 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-5ca2ab97-9dd1-4f02-bbe6-97239b4ea181 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3125205
Jun 02 16:41:28.533494 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8420edb6-b795-49bb-8576-35cf7af1a3a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.549359 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c00c2b0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 2, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:28.562836 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:28.563194 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Updating router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 port a136648f-8d38-4ebc-9c83-dec23c8c9621 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:28.599235 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:28.682006 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.695316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.714115 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44adcfc-5c26-48cc-a74c-d8d7325e0f1b req-9a2feb8e-d37c-4375-a4b4-2d463aa21ed0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:28.715676 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d44adcfc-5c26-48cc-a74c-d8d7325e0f1b req-9a2feb8e-d37c-4375-a4b4-2d463aa21ed0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1547420
Jun 02 16:41:28.733944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:28.739817 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Usage tracker for resource:security_group_rule and tenant:4403db650ec04a6d8c45fa3bdd777286 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:28.744257 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:28.752471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:28.832288 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-d29d7c99-5c89-4094-b4b3-fdb22c19a7f1 service neutron] 10.222.0.25 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3157065
Jun 02 16:41:28.840577 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d44adcfc-5c26-48cc-a74c-d8d7325e0f1b req-563deeda-6888-480d-84f3-a926a34d58f5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1163602
Jun 02 16:41:28.878880 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.974045 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:28.985294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:28.991285 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.001353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-574aa989-b372-44c9-96c3-f2931274293a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:29.001532 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:29.003585 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.004731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.011605 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:29.056410 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-dd9ba316-dcf1-4321-b1c1-57fd4e31aa13 service neutron] 10.222.0.25 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2160800
Jun 02 16:41:29.058637 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4403db650ec04a6d8c45fa3bdd777286&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7325828
Jun 02 16:41:29.061477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51020) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:29.071948 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2d137b6-2c39-4db1-9271-012d3b8f82e5,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:29.077321 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:29.189399 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Pushing event updated for resources: {'Subnet': ['ID=866a4c65-75ff-4446-b1dc-0dbfdf1b68a4,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:29.191365 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.197101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:29.232005 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Checking segment: {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:29.234534 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Network hostable DHCP agents. Network: 2e981188-5c9f-4f7b-87dd-07a67b33db56, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:41:29.276417 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda5759f-1b7a-4835-9a2d-29e5a990ea52 req-619e9714-11c7-4f6d-9631-b9fa0ba69515 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:29.278884 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cda5759f-1b7a-4835-9a2d-29e5a990ea52 req-619e9714-11c7-4f6d-9631-b9fa0ba69515 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 944 time: 0.2360814
Jun 02 16:41:29.280463 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:41:29.292558 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.330991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.341501 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cda5759f-1b7a-4835-9a2d-29e5a990ea52 req-a897b7ab-a62a-4cd7-8b55-ebdae52a0fd3 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0504322
Jun 02 16:41:29.342278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 2e981188-5c9f-4f7b-87dd-07a67b33db56) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:29.362474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:29.363308 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.397968 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8741050f-030d-4409-a230-532120dd4578 None None] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:29.410107 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.4145968
Jun 02 16:41:29.413994 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51030) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:29.419626 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:29.424747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:29.428980 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Usage tracker for resource:router and tenant:1be1536c4ea0412a9c5fbd5dc1f04d9f is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:29.434643 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:29.496448 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:29.511897 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-191c9070-d129-4e41-b5ff-b11a2e98fb68 req-76f61a6c-30ab-45e8-9c90-13556570b694 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 210 time: 0.0790586
Jun 02 16:41:29.536372 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.537714 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.545553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:29.583390 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.587217 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.599242 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:29.604044 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3b9d01d-7a53-466c-a516-2173233df701" -d '{"events": [{"server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "name": "network-vif-plugged", "status": "completed", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:29.616113 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.621131 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:29.637578 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35dcd478-00a4-4461-a9ca-d5bfcfa9a3d0 req-b76ea1bd-d418-4b8a-bfe7-89c60267e60d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:29.639604 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35dcd478-00a4-4461-a9ca-d5bfcfa9a3d0 req-b76ea1bd-d418-4b8a-bfe7-89c60267e60d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.2397392
Jun 02 16:41:29.680457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.688994 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e1a85daa-2a47-48f4-a785-aa3eed5ccc53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:29.717963 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2d137b6-2c39-4db1-9271-012d3b8f82e5,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:29.733425 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:29.753529 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35dcd478-00a4-4461-a9ca-d5bfcfa9a3d0 req-79b4922b-7072-4559-8ef9-846e5053bd75 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0929348
Jun 02 16:41:29.758672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.761416 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f2d137b6-2c39-4db1-9271-012d3b8f82e5 HTTP/1.1" status: 204  len: 168 time: 0.6988125
Jun 02 16:41:29.785360 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Transition to ACTIVE for port object a136648f-8d38-4ebc-9c83-dec23c8c9621 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:29.828918 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:29.833059 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:29.845549 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:29.860753 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:30.082448 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-364d8d2f-eb2c-402b-be06-51f5d6f982b7 x-openstack-request-id: req-364d8d2f-eb2c-402b-be06-51f5d6f982b7 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:30.083156 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "name": "network-vif-plugged", "status": "completed", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:30.083336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-364d8d2f-eb2c-402b-be06-51f5d6f982b7 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:30.087884 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435', 'code': 200}
Jun 02 16:41:30.186426 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Pushing event updated for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:30.285355 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:30.404499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:30.418725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae2fd8b-65d2-4742-ae20-f0e3e0ae3b3c req-240575bc-9675-4e54-b67f-381fe814105a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:30.423941 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2ae2fd8b-65d2-4742-ae20-f0e3e0ae3b3c req-240575bc-9675-4e54-b67f-381fe814105a service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 1098 time: 0.2319915
Jun 02 16:41:30.440523 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.515109 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2ae2fd8b-65d2-4742-ae20-f0e3e0ae3b3c req-7e93fe7d-20f4-4619-b5bd-7417ac0588a8 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0767906
Jun 02 16:41:30.553913 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffadec6-d674-4c8e-a090-57a5c99680a2 req-485b06af-a8a0-4db7-b6d7-c6374cf62b29 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:30.561518 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5ffadec6-d674-4c8e-a090-57a5c99680a2 req-485b06af-a8a0-4db7-b6d7-c6374cf62b29 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2743261
Jun 02 16:41:30.579719 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.604189 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Attempting to bind port a136648f-8d38-4ebc-9c83-dec23c8c9621 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:30.604581 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Attempting to bind port a136648f-8d38-4ebc-9c83-dec23c8c9621 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:30.605046 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Attempting to bind port a136648f-8d38-4ebc-9c83-dec23c8c9621 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:30.638263 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0da154e-5a91-4a5c-b94f-8f1fb499e4e3 req-48b9cf96-5eaa-40f0-92d3-f179cb7806b4 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:30.647412 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0da154e-5a91-4a5c-b94f-8f1fb499e4e3 req-48b9cf96-5eaa-40f0-92d3-f179cb7806b4 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 945 time: 0.0943346
Jun 02 16:41:30.649428 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:30.649963 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:30.650464 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.651048 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Bound using segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:30.651628 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Bound port: a136648f-8d38-4ebc-9c83-dec23c8c9621, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:30.652200 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.668293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-2e981188-5c9f-4f7b-87dd-07a67b33db56', 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'fixed_ips': [{'subnet_id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:41:30.669303 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.688036 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5ffadec6-d674-4c8e-a090-57a5c99680a2 req-f1b15589-af30-48b7-b118-f257f994342d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1165919
Jun 02 16:41:30.696138 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:30.696730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:30.710296 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0da154e-5a91-4a5c-b94f-8f1fb499e4e3 req-dd2873f8-d724-4dc9-9f0f-b4baad9d07a8 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616047
Jun 02 16:41:30.927872 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-534a1809-bc98-4636-806c-b671c8dcabd9 req-6ab58cd4-5ec1-41e9-8207-294033b7c419 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 210 time: 0.1137545
Jun 02 16:41:31.010679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.041797 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.049757 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Allocated IP 172.20.0.2 (2e981188-5c9f-4f7b-87dd-07a67b33db56/866a4c65-75ff-4446-b1dc-0dbfdf1b68a4/74d834d9-79d2-4849-93a5-fa462268dcb2) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:31.288511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98af3d6d-c0c3-4e9a-a577-f83f025b348a req-fa8ffb3c-58e1-4e16-9ac6-79366b12d96b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:31.302966 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-98af3d6d-c0c3-4e9a-a577-f83f025b348a req-fa8ffb3c-58e1-4e16-9ac6-79366b12d96b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.4195774
Jun 02 16:41:31.322971 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Allocated IP 172.27.0.64 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/7a74e070-e05b-4476-9b2b-ebdd5aeee5d2) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:31.334013 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] For port a136648f-8d38-4ebc-9c83-dec23c8c9621, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:31.379488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] For port a136648f-8d38-4ebc-9c83-dec23c8c9621, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=a136648f-8d38-4ebc-9c83-dec23c8c9621,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:31.436331 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.471034 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:31.573375 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-98af3d6d-c0c3-4e9a-a577-f83f025b348a req-caf302f7-fa18-455d-8fe6-a6b2e4781d05 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2633977
Jun 02 16:41:31.645870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.653257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.656425 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:31.657227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c00c2b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:31.674346 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-3bbcd4d1-ccf7-464f-996c-ab2886b996bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:31.675874 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-3bbcd4d1-ccf7-464f-996c-ab2886b996bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 811 time: 0.4501045
Jun 02 16:41:31.691453 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:31.696995 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:31.844053 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-d87820d8-3f9e-439c-bcdb-0904478da20f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 380 time: 0.1432333
Jun 02 16:41:31.859371 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:31.862524 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'port': {'device_id': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'admin_state_up': True, 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'security_groups': ['82ded133-9206-48c1-9cff-f5d790937039']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:31.862772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:31.866762 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:31.966744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Pushing event updated for resources: {'Port': ['ID=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:32.011255 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.314s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:32.066010 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Pushing event updated for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:32.079833 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.609s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:32.094488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Transition to ACTIVE for port object 74d834d9-79d2-4849-93a5-fa462268dcb2 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:32.128250 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:32.203526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:32.208386 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:32.223086 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c8f4b0-cff3-496a-a648-cae8d74e1a1e req-4bddc65b-4ca6-4889-9e23-4b9eff1cc189 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:32.231593 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99c8f4b0-cff3-496a-a648-cae8d74e1a1e req-4bddc65b-4ca6-4889-9e23-4b9eff1cc189 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 945 time: 0.2616355
Jun 02 16:41:32.234448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:32.282692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Made reservation on behalf of 5febf86d75284ccb9dac5e0dadffd715 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:32.292974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:32.343468 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99c8f4b0-cff3-496a-a648-cae8d74e1a1e req-cdc11f9e-e3fe-4a31-9908-55a19a273f6f tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1105890
Jun 02 16:41:32.418088 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed8d445-7225-4fb0-9763-b6c6a2a4335d req-97b54d54-63b4-4a7b-b2e2-57e971f639d1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:32.427751 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2ed8d445-7225-4fb0-9763-b6c6a2a4335d req-97b54d54-63b4-4a7b-b2e2-57e971f639d1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.4504664
Jun 02 16:41:32.679530 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Transition to ACTIVE for port object 74d834d9-79d2-4849-93a5-fa462268dcb2 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:32.697228 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2ed8d445-7225-4fb0-9763-b6c6a2a4335d req-68538616-f3ad-4fe5-b155-f284ba44f9f2 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2669015
Jun 02 16:41:32.701266 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:32.714583 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-21225bcd-6197-450b-b17a-ebd42c616f4a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:32.750453 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae49e93e-7132-4e7d-8fa9-20501674f457 req-340ea83c-35ed-414f-b9b4-cc7db0542ba1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 210 time: 0.1138613
Jun 02 16:41:32.774716 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:32.780687 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:32.802696 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:32.806802 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Allocated IP 172.20.0.8 (715517d1-0353-4b9d-972e-92eb6241fe32/200a3016-0d3b-4aef-b80d-de65cae94521/9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:32.920079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51158) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:32.976502 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.032273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Pushing event updated for resources: {'Port': ['ID=74d834d9-79d2-4849-93a5-fa462268dcb2,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:33.042388 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:33.069059 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Attempting to bind port 74d834d9-79d2-4849-93a5-fa462268dcb2 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:33.069551 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Attempting to bind port 74d834d9-79d2-4849-93a5-fa462268dcb2 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:33.070074 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Attempting to bind port 74d834d9-79d2-4849-93a5-fa462268dcb2 on network 2e981188-5c9f-4f7b-87dd-07a67b33db56 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:33.091744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:33.092796 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Checking segment: {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:33.092919 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.093481 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Bound using segment: {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:33.094035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Bound port: 74d834d9-79d2-4849-93a5-fa462268dcb2, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:33.094530 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.151161 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.178678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.186132 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:33.201797 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Usage tracker for resource:security_group_rule and tenant:52866fc2b7e84e7da0b0f128c71d787b is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:33.217992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:33.222838 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Transition to ACTIVE for port object 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:33.228718 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:33.233451 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c00c2b0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:31Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:33.240151 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] For port 74d834d9-79d2-4849-93a5-fa462268dcb2, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:33.242949 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0aa3cc1-16e4-4750-949c-895a5cb8a5c9 None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:31Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:33.246074 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] For port 74d834d9-79d2-4849-93a5-fa462268dcb2, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=74d834d9-79d2-4849-93a5-fa462268dcb2,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:33.255821 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.277805 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:33.345342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.361385 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5110b3ec-2b71-4397-9377-9f11f7ed1d40 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:33.421985 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Pushing event updated for resources: {'Port': ['ID=74d834d9-79d2-4849-93a5-fa462268dcb2,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:33.428220 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:33.517237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:33.527242 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:33.536658 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:33.539394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:33.593690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:33.699233 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.731394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.753141 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.753849 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.804989 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af4ebad2-b802-4ce8-9e54-92f663585583 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:33.850077 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:33.851004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:33.938181 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=52866fc2b7e84e7da0b0f128c71d787b&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0167286
Jun 02 16:41:33.957267 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51194) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:34.078524 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2da05e10-84a9-4059-8fb8-4ee8e3d88c1a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:34.084851 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.2267799
Jun 02 16:41:34.095740 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:34.102774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Request body: {'port': {'device_id': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:34.119415 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-81cb17ba-94b4-4a6c-bbc9-1d579467108e None None] Provisioning for port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:34.131431 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-81cb17ba-94b4-4a6c-bbc9-1d579467108e None None] Provisioning complete for port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:34.131944 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-81cb17ba-94b4-4a6c-bbc9-1d579467108e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.197364 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.252390 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-81cb17ba-94b4-4a6c-bbc9-1d579467108e None None] Port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:34.259827 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Router e93b0099-718d-481a-becb-9609450b08d5 is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98278) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:41:34.264737 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.347178 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec05ba23-ee07-47b8-b504-dafe1657a3ba req-895d00c9-2403-4e0d-ac78-74b12fe84a85 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:34.350062 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ec05ba23-ee07-47b8-b504-dafe1657a3ba req-895d00c9-2403-4e0d-ac78-74b12fe84a85 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2500150
Jun 02 16:41:34.399504 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device a136648f-8d38-4ebc-9c83-dec23c8c9621 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:34.465508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.470680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port a136648f-8d38-4ebc-9c83-dec23c8c9621 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:34.479600 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port a136648f-8d38-4ebc-9c83-dec23c8c9621 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:34.480071 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.522855 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ec05ba23-ee07-47b8-b504-dafe1657a3ba req-1d87bf22-353b-44c2-ba6a-62e19bae3ac7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1659451
Jun 02 16:41:34.607316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398a85ec-ed41-4ceb-8ddb-44ba3314722b req-6562a2d1-1dcc-4674-9a2c-54ef8f65224e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:34.608233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-398a85ec-ed41-4ceb-8ddb-44ba3314722b req-6562a2d1-1dcc-4674-9a2c-54ef8f65224e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:34.618487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:34.631312 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Sync routers for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:34.647681 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:34.648063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] Notify callbacks [] for router, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.648558 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1d6a90>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:34.649481 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4cf46f95-1518-4432-b48d-39809e0ba0d4 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 5.2342925
Jun 02 16:41:34.652495 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51200) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:34.699968 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.705510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.719767 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ae610a5a-075f-4709-88b7-5b26c8386605 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:34.747374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-398a85ec-ed41-4ceb-8ddb-44ba3314722b req-6562a2d1-1dcc-4674-9a2c-54ef8f65224e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:34.755845 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-398a85ec-ed41-4ceb-8ddb-44ba3314722b req-6562a2d1-1dcc-4674-9a2c-54ef8f65224e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 931 time: 0.4519801
Jun 02 16:41:34.776123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port a136648f-8d38-4ebc-9c83-dec23c8c9621, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=a136648f-8d38-4ebc-9c83-dec23c8c9621,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:34.783469 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.784533 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 74d834d9-79d2-4849-93a5-fa462268dcb2 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:34.803912 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:34.810698 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2da05e10-84a9-4059-8fb8-4ee8e3d88c1a HTTP/1.1" status: 204  len: 168 time: 0.8387151
Jun 02 16:41:34.811797 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2da05e10-84a9-4059-8fb8-4ee8e3d88c1a,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:34.825230 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:34.918476 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-398a85ec-ed41-4ceb-8ddb-44ba3314722b req-eff3e996-5736-43ba-aa3c-f62ffd164b8c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1600192
Jun 02 16:41:34.946595 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-08daad34-b175-4a68-85c1-0a0cc1b0864c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:35.132971 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed455248-8113-421a-a856-db535933e4c8 None None] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:35.135799 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:35.376647 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 74d834d9-79d2-4849-93a5-fa462268dcb2 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:35.434702 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Provisioning for port 74d834d9-79d2-4849-93a5-fa462268dcb2 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:35.460680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Provisioning complete for port 74d834d9-79d2-4849-93a5-fa462268dcb2 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:35.461107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:35.543666 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:35.549419 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.611s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:35.816271 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1d6a90>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:32Z', 'revision_number': 3, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:35.821376 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Checking router: e93b0099-718d-481a-becb-9609450b08d5 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:35.822029 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Updating router e93b0099-718d-481a-becb-9609450b08d5 port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:35.888048 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ad971c-546f-47f4-83bf-9eaa015b4530 req-93eb0692-8910-47b0-9733-5f37b3bb4cc2 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:35.890317 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:35.898357 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-53ad971c-546f-47f4-83bf-9eaa015b4530 req-93eb0692-8910-47b0-9733-5f37b3bb4cc2 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 945 time: 0.4796357
Jun 02 16:41:35.969754 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.060187 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] For port 74d834d9-79d2-4849-93a5-fa462268dcb2, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=74d834d9-79d2-4849-93a5-fa462268dcb2,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:36.067924 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.070127 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:36.210700 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Pushing event updated for resources: {'Port': ['ID=74d834d9-79d2-4849-93a5-fa462268dcb2,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:36.226587 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:36.250051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:36.266980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.303245 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-53ad971c-546f-47f4-83bf-9eaa015b4530 req-e95cd3be-56f6-4d54-836e-b3bd0402309f tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4038732
Jun 02 16:41:36.345482 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Transition to ACTIVE for port object 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:36.359320 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.381740 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:36.396147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device a136648f-8d38-4ebc-9c83-dec23c8c9621 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:36.554472 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port a136648f-8d38-4ebc-9c83-dec23c8c9621 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:36.555367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.610633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51240) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:36.664474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb453b8b-8eaa-4a3e-8605-a94f51e69424 req-6db33de9-7e4d-4b9b-ba1f-1c95588762a2 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:36.665974 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cb453b8b-8eaa-4a3e-8605-a94f51e69424 req-6db33de9-7e4d-4b9b-ba1f-1c95588762a2 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.5227263
Jun 02 16:41:36.678958 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.695009 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Transition to ACTIVE for port object 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:36.705952 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.719836 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:36.747504 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.812694 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 74d834d9-79d2-4849-93a5-fa462268dcb2 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:36.814022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-f75ef641-ef24-4434-ac6f-0ee48919fbfd tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:36.816322 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-f75ef641-ef24-4434-ac6f-0ee48919fbfd tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 945 time: 0.7537718
Jun 02 16:41:36.851030 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cb453b8b-8eaa-4a3e-8605-a94f51e69424 req-a5bb97a3-ba02-4ad7-9f83-c0e2863a6ecd tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1745520
Jun 02 16:41:36.866988 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Pushing event updated for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:36.904965 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1169355156-network', 'tenant_id': '72708e56387e47539c517fd7fe956ea3'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:36.912182 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:36.926394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Usage tracker for resource:network and tenant:72708e56387e47539c517fd7fe956ea3 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:36.931738 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:36.945207 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Attempting to bind port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:36.946356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:36.947642 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Attempting to bind port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:36.949009 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Attempting to bind port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:36.973440 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:36.975366 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:36.976326 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.976996 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:36.978901 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Bound port: 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:36.982384 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:36.984576 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-f62e6b74-a89a-4fd5-ae9e-24f169d6763d None None] Provisioning complete for port 74d834d9-79d2-4849-93a5-fa462268dcb2 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:36.985486 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-f62e6b74-a89a-4fd5-ae9e-24f169d6763d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.030008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 74d834d9-79d2-4849-93a5-fa462268dcb2 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:37.030637 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.042490 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.661s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:37.088418 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] For port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:37.091939 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] For port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:37.106457 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f3826c-06da-4d19-b4a9-8495a5cf808e None None] Pushing event updated for resources: {'Port': ['ID=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,revision_number=2']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:37.112711 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.115846 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-81f3826c-06da-4d19-b4a9-8495a5cf808e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.396s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:37.124599 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:37.160359 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Allocated IP 172.20.0.1 (2e981188-5c9f-4f7b-87dd-07a67b33db56/866a4c65-75ff-4446-b1dc-0dbfdf1b68a4/0edec0c6-96bd-4edc-bbb7-22919b9b88b6) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:37.167311 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Attempting to bind port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:37.167723 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Attempting to bind port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:37.168187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Attempting to bind port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:37.175867 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 on network 715517d1-0353-4b9d-972e-92eb6241fe32 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:37.176190 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Attempting to bind port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:37.203125 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:37.203948 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1d6a90>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:37.237060 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:37.237771 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Checking segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:37.238647 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Bound using segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:37.239235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Bound port: 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:37.239734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.283824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c686ad-976b-4d2c-b426-327751b38442 req-f0c513ba-cf30-42ea-89bd-382c270445df tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:37.287403 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f3826c-06da-4d19-b4a9-8495a5cf808e None None] Pushing event updated for resources: {'Port': ['ID=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:37.289905 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c0c686ad-976b-4d2c-b426-327751b38442 req-f0c513ba-cf30-42ea-89bd-382c270445df tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 943 time: 0.5858834
Jun 02 16:41:37.299149 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-81f3826c-06da-4d19-b4a9-8495a5cf808e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:37.448671 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c0c686ad-976b-4d2c-b426-327751b38442 req-b4f9989f-2c91-4de2-9b36-ff7193f959bf tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1179862
Jun 02 16:41:37.458069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.475885 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:37.476844 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Transition to ACTIVE for port object 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:37.500813 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Made reservation on behalf of 72708e56387e47539c517fd7fe956ea3 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:37.504460 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.523773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Deleting port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:41:37.524045 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.542944 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.549556 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:37.574691 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.587554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-eee9bee2-6360-452c-90c5-e5afd7648e50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:37.588137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:37.641619 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.649173 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:37.725292 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:37.746787 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:37.749654 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Usage tracker for resource:security_group_rule and tenant:72708e56387e47539c517fd7fe956ea3 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:37.753247 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:37.760162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:37.760162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.761431 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] 10.222.0.20 "PUT /v2.0/ports/9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 1093 time: 3.6628845
Jun 02 16:41:37.762271 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:37.763532 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Pushing event updated for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:37.766030 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:37.779172 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-505973d9-78e6-4746-b64c-e59f09a22c7f" -d '{"events": [{"name": "network-changed", "server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:37.779673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:37.801592 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] For port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:37.802100 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:37.895877 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:37.908104 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:38.060486 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1d6a90>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:32Z', 'revision_number': 3, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:38.065489 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62e0a947-ff4f-44cd-93dc-85b6395197cd None None] The sync data for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi is: [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:32Z', 'revision_number': 3, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:38.134787 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.181712 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5eba1c-7e8a-4e02-bd6b-16681b0142f5 req-52b7bbc4-59e9-4477-864f-01eaa9d8c9b4 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:38.189266 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e5eba1c-7e8a-4e02-bd6b-16681b0142f5 req-52b7bbc4-59e9-4477-864f-01eaa9d8c9b4 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 945 time: 0.6489513
Jun 02 16:41:38.205980 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-f4116056-e684-4208-a10f-832fa3cfc3cf None None] Provisioning for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:38.216841 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48d0680e-d21c-4412-86e5-a1f2d3a9959a x-openstack-request-id: req-48d0680e-d21c-4412-86e5-a1f2d3a9959a {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:38.217296 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:38.217482 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-48d0680e-d21c-4412-86e5-a1f2d3a9959a {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:38.217928 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'status': 'completed', 'code': 200}
Jun 02 16:41:38.220604 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-f4116056-e684-4208-a10f-832fa3cfc3cf None None] Provisioning complete for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:38.221003 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-f4116056-e684-4208-a10f-832fa3cfc3cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.228990 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Calling delete_port for 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:41:38.234984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Pushing event updated for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:38.288943 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.289569 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.290177 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.290691 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.291368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.291874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.292370 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.292859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.293360 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.293870 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.294377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.294859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.306479 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.657s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:38.320604 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e5eba1c-7e8a-4e02-bd6b-16681b0142f5 req-79abb193-94c9-43b7-a97c-e501980e93fe tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1304097
Jun 02 16:41:38.336840 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.344598 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.350942 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-f4116056-e684-4208-a10f-832fa3cfc3cf None None] Port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:38.359457 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] vlan segment allocate from pool success with {'vlan_id': 657, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:41:38.365272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:38.386295 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-5b1affd3-f487-4c3b-9610-cd2ffbcced13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:38.387797 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-5b1affd3-f487-4c3b-9610-cd2ffbcced13 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1096 time: 0.5756543
Jun 02 16:41:38.389705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.390223 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Added segment de8524f2-4726-4e27-8579-005e36672ca4 of type vlan for network 87782ba6-7481-4054-b9f8-31430743d283
Jun 02 16:41:38.435104 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cb54ad4-55cc-4987-b203-566abb562d0e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:38.454006 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.460289 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.460649 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.460998 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.461341 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.461792 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.462134 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.462471 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.462804 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.463141 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.463476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.463805 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.464132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:38.468350 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:38.468635 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bb9063-6021-4594-ae47-181cf75dd4bb req-78fe0993-a5cd-4478-b621-54187b492670 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:38.470271 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71bb9063-6021-4594-ae47-181cf75dd4bb req-78fe0993-a5cd-4478-b621-54187b492670 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2380137
Jun 02 16:41:38.598616 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.613299 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.617771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:38.618313 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.619562 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-3180d104-365d-4864-b745-d4144cb2a2b7 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 217 time: 0.2186475
Jun 02 16:41:38.624902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-22c1a055-2fbc-4d81-9c45-716b2f2f8d12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:38.657705 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:41:38.787702 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-71bb9063-6021-4594-ae47-181cf75dd4bb req-dec312ab-b5af-48c2-b7e2-d07d9f03cb84 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1711438
Jun 02 16:41:38.802275 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.817529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-5c13c7aa-72ca-456c-8683-134a447a1cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:38.819099 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-5c13c7aa-72ca-456c-8683-134a447a1cbd service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.1854179
Jun 02 16:41:38.864340 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:38.864558 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Pushing event updated for resources: {'Network': ['ID=87782ba6-7481-4054-b9f8-31430743d283,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:38.871352 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:38.881093 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 2.2633817
Jun 02 16:41:38.881301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 87782ba6-7481-4054-b9f8-31430743d283 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:41:38.882136 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51270) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:38.883955 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bde038db-4467-4eac-8122-ef7ebe156213 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:38.894439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Request body: {'subnet': {'network_id': '87782ba6-7481-4054-b9f8-31430743d283', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1169355156-subnet', 'tenant_id': '72708e56387e47539c517fd7fe956ea3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:38.906437 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:38.926435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Usage tracker for resource:subnet and tenant:72708e56387e47539c517fd7fe956ea3 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:38.933521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:38.942440 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:38.946041 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Pushing event deleted for resources: {'Port': ['ID=2b18f1d1-11cc-40ea-818e-7eb8d8c14435,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:38.956462 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:39.080439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] No DVR routers for this DVR port 2b18f1d1-11cc-40ea-818e-7eb8d8c14435 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:41:39.083704 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:39.108861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421173bc-710e-446d-868d-97a4221df7ee req-b37d5a3e-aba6-47f7-a3e2-833b2af410c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:39.111059 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-b37d5a3e-aba6-47f7-a3e2-833b2af410c4 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2846732
Jun 02 16:41:39.112550 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8b25a7e9-2b1c-42f9-84ea-bf3d1a3821ad req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "DELETE /v2.0/ports/2b18f1d1-11cc-40ea-818e-7eb8d8c14435 HTTP/1.1" status: 204  len: 173 time: 2.2353919
Jun 02 16:41:39.157957 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb065a9-ba3e-4f9d-b40e-5909846886ca req-3f62d2a0-6b02-4a4b-b7a2-7dc264fe2bee tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:39.165381 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ceb065a9-ba3e-4f9d-b40e-5909846886ca req-3f62d2a0-6b02-4a4b-b7a2-7dc264fe2bee tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 943 time: 0.5185101
Jun 02 16:41:39.172671 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Made reservation on behalf of 72708e56387e47539c517fd7fe956ea3 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:39.175376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:39.326353 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-20d067f3-c202-4b6f-9c54-6ae9e967eb89 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2036607
Jun 02 16:41:39.348349 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ceb065a9-ba3e-4f9d-b40e-5909846886ca req-854d4960-aec0-421f-a6b7-441ce26250d1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:39.390000 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ceb065a9-ba3e-4f9d-b40e-5909846886ca req-854d4960-aec0-421f-a6b7-441ce26250d1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:39.399281 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ceb065a9-ba3e-4f9d-b40e-5909846886ca req-854d4960-aec0-421f-a6b7-441ce26250d1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2318435
Jun 02 16:41:39.450504 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:39.460487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:39.501868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9b0e35de-aaa2-432f-b1af-6db925330ac8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:39.617019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-927dc184-d759-451f-96c9-c1c88258761c req-e87b5a9b-36a0-4eb7-9e34-74893219b133 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:39.636504 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Pushing event updated for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:39.642538 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:39.645077 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:39.658429 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-421173bc-710e-446d-868d-97a4221df7ee req-33bc013c-9983-41c7-9040-d1dd731291ed service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3222356
Jun 02 16:41:39.667347 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-927dc184-d759-451f-96c9-c1c88258761c req-e87b5a9b-36a0-4eb7-9e34-74893219b133 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:39.669109 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-927dc184-d759-451f-96c9-c1c88258761c req-e87b5a9b-36a0-4eb7-9e34-74893219b133 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=c2af2169-5a90-4db5-9eaf-7253e51e10a1 HTTP/1.1" status: 200  len: 210 time: 0.1262386
Jun 02 16:41:39.682430 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd90b07e-c846-422b-9b05-fce8a4602ec1 req-d722a699-43ae-42a4-b855-883032c0fa3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:39.683974 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd90b07e-c846-422b-9b05-fce8a4602ec1 req-d722a699-43ae-42a4-b855-883032c0fa3b service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.1785197
Jun 02 16:41:39.787422 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dd90b07e-c846-422b-9b05-fce8a4602ec1 req-0c15ba72-6213-4227-91ea-207be04013e1 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0813026
Jun 02 16:41:39.826272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-5dd32e76-661f-4d46-8e86-a719d5eddd91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:39.828192 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-5dd32e76-661f-4d46-8e86-a719d5eddd91 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1096 time: 0.1057103
Jun 02 16:41:39.866121 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:39.868813 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:40.053858 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-546c2c5a-63e0-435a-a9cb-a084edaea7ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:40.055353 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-546c2c5a-63e0-435a-a9cb-a084edaea7ed service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1871030
Jun 02 16:41:40.159323 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-18ddbe41-e183-4a6f-aa8b-910cca3f13f5 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 217 time: 0.0815799
Jun 02 16:41:40.211840 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d846e915-54d9-412f-ada5-7a96da2bb430 req-3bc2cb36-c02b-4037-9db2-fc10f309f13d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:40.213358 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d846e915-54d9-412f-ada5-7a96da2bb430 req-3bc2cb36-c02b-4037-9db2-fc10f309f13d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2716215
Jun 02 16:41:40.228935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'name': 'network-vif-deleted', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:40.231457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5474f51-b666-441c-86ad-65d910fea023" -d '{"events": [{"server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "name": "network-vif-deleted", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:40.246148 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-95c12dc5-f91a-4109-bfa7-3a043d47e8cc None None] Provisioning complete for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:40.246655 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-95c12dc5-f91a-4109-bfa7-3a043d47e8cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:40.277500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-19633f51-c836-41e6-88c6-8678bb5684ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:40.279174 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-19633f51-c836-41e6-88c6-8678bb5684ed service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.1125715
Jun 02 16:41:40.357261 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:40.372777 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-95c12dc5-f91a-4109-bfa7-3a043d47e8cc None None] Port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:41:40.373251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Router e93b0099-718d-481a-becb-9609450b08d5 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:41:40.375509 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f5ce784e-b671-49a3-ae76-c5b8af3c6591 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:40.415471 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:40.426493 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-8d8b4554-f293-44d2-8e3d-41d76e6e9b60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:40.428220 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-8d8b4554-f293-44d2-8e3d-41d76e6e9b60 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1259654
Jun 02 16:41:40.449237 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d846e915-54d9-412f-ada5-7a96da2bb430 req-d3df715d-ad53-4a94-97a6-4b2510106e7a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2163830
Jun 02 16:41:40.509680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:40.516202 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:40.516840 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:40.561751 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bee9455e-102a-42e5-a24b-eb495caf696b x-openstack-request-id: req-bee9455e-102a-42e5-a24b-eb495caf696b {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:40.562073 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2af2169-5a90-4db5-9eaf-7253e51e10a1", "name": "network-vif-deleted", "tag": "2b18f1d1-11cc-40ea-818e-7eb8d8c14435", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:40.562348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-bee9455e-102a-42e5-a24b-eb495caf696b {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:40.562765 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2af2169-5a90-4db5-9eaf-7253e51e10a1', 'name': 'network-vif-deleted', 'tag': '2b18f1d1-11cc-40ea-818e-7eb8d8c14435', 'status': 'completed', 'code': 200}
Jun 02 16:41:40.623657 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-557d2013-2c6f-4afd-b06b-cd5452cb9df7 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1827421
Jun 02 16:41:40.666554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5c2a516d-6355-4d25-a0bf-a043ecc26f20,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:40.682087 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:40.693931 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:40.719083 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:40.727260 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:40.730933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:40.781630 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Checking segment: {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:40.782135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Network hostable DHCP agents. Network: 87782ba6-7481-4054-b9f8-31430743d283, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:41:40.810554 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-505973d9-78e6-4746-b64c-e59f09a22c7f req-f3902224-78b9-4e47-a6b4-b0e99c08af49 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1765847
Jun 02 16:41:40.829262 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:40.838500 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:40.907168 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Network 87782ba6-7481-4054-b9f8-31430743d283 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:41:40.926400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:40.938488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Sync routers for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:40.950793 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:40.951149 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 87782ba6-7481-4054-b9f8-31430743d283) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:40.953873 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77599130>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:40.959278 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] 10.222.0.25 "PUT /v2.0/routers/e93b0099-718d-481a-becb-9609450b08d5/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.3056791
Jun 02 16:41:40.991930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac949de-6546-4f53-b40d-180c50d77a5b req-18720795-c124-4627-abb1-ef509d6b1f4f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:40.995068 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ac949de-6546-4f53-b40d-180c50d77a5b req-18720795-c124-4627-abb1-ef509d6b1f4f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 943 time: 0.2916002
Jun 02 16:41:41.000349 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:41.002042 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:41.051382 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ce2e733b-e325-4f94-bd6f-fcb40a4aac82 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 2.1683559
Jun 02 16:41:41.078257 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ac949de-6546-4f53-b40d-180c50d77a5b req-56d63550-2b57-4e47-afab-dfbaa8be59aa tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0685015
Jun 02 16:41:41.136824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74263a5a-5ba7-4508-ab4e-6ea1ec0c51d8 None None] Network 87782ba6-7481-4054-b9f8-31430743d283 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:41.334471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a8b239-e1c9-41de-a5e7-9e46f8dc105c req-387fb075-0efb-46b1-85b7-4b915a78c4c2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:41.336163 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-83a8b239-e1c9-41de-a5e7-9e46f8dc105c req-387fb075-0efb-46b1-85b7-4b915a78c4c2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.2177811
Jun 02 16:41:41.397872 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-83a8b239-e1c9-41de-a5e7-9e46f8dc105c req-e686ed50-63fb-4451-94c3-65ec364d2a29 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0559082
Jun 02 16:41:41.404132 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:41.542092 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-fd5fe766-9538-4a7f-a8f4-617fefd9ef99 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:41.542960 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-fd5fe766-9538-4a7f-a8f4-617fefd9ef99 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:41.564549 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-fd5fe766-9538-4a7f-a8f4-617fefd9ef99 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:41.566517 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-fd5fe766-9538-4a7f-a8f4-617fefd9ef99 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 808 time: 0.3287365
Jun 02 16:41:41.592189 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-892a7387-8f5a-4a11-9b5c-d3c5086269d5 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/quotas/a1836d0c3dbd473ca08d38562b52e19d HTTP/1.1" status: 200  len: 375 time: 0.0133228
Jun 02 16:41:41.655793 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-856fbb29-ba47-4717-a08e-eccdf0793c35 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0590560
Jun 02 16:41:41.662029 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33c3674f-afb5-44ea-8a06-3fc77d4ab4b3 None None] Network 87782ba6-7481-4054-b9f8-31430743d283 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:41:41.894450 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-ff621917-0c7c-4e45-bd95-807f9dbf4107 service neutron] 10.222.0.25 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2300045
Jun 02 16:41:42.054889 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-dcce7d89-c038-495f-a86d-7b1fd0aba24a service neutron] 10.222.0.25 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1593597
Jun 02 16:41:42.068036 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77599130>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:38Z', 'revision_number': 4, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '0edec0c6-96bd-4edc-bbb7-22919b9b88b6', 'name': '', 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'mac_address': 'fa:16:3e:07:6b:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:36Z', 'updated_at': '2021-06-02T16:41:38Z', 'revision_number': 2, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'subnets': [{'id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:42.072770 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Checking router: e93b0099-718d-481a-becb-9609450b08d5 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:42.073188 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Updating router e93b0099-718d-481a-becb-9609450b08d5 port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:41:42.191978 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.229454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51350) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:42.236031 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1074292760', 'description': 'tempest-secgroup-smoke-1074292760 description', 'project_id': '2be2419a57e644b38a5c0ca942660a19'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:42.246845 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:42.255437 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:42.265357 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:42.282340 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:42.297526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.408515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:42.413228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:42.423586 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:42.427999 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:42.436471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:42.520958 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e645bd-f68b-446c-aaa2-5bce4ca6623c req-c7c2b9b4-f0af-41db-a127-af3bff3e8fdd tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:42.529090 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-09e645bd-f68b-446c-aaa2-5bce4ca6623c req-c7c2b9b4-f0af-41db-a127-af3bff3e8fdd tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 943 time: 0.1885252
Jun 02 16:41:42.621008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:42.622106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.643583 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.655833 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e92d748-b780-4dc1-81e7-78875063d6d6 req-fe9a0611-2af9-49a2-8a27-19b80ee78465 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:42.657991 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4e92d748-b780-4dc1-81e7-78875063d6d6 req-fe9a0611-2af9-49a2-8a27-19b80ee78465 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1368456
Jun 02 16:41:42.670705 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-09e645bd-f68b-446c-aaa2-5bce4ca6623c req-337bad67-fbdf-478d-8ba3-6c1335568094 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1405056
Jun 02 16:41:42.672191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.685527 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:41:42.685897 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dca03300-b7cb-4948-b488-21d008fe4d62 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:42.726072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4e92d748-b780-4dc1-81e7-78875063d6d6 req-7c09083a-2254-486c-81fc-1f0f9f4eac04 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618498
Jun 02 16:41:42.749281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.750660 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.5183780
Jun 02 16:41:42.753656 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51364) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:42.758514 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:42.766845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:42.782317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:42.794424 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:42.800867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:42.820304 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:42.834925 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroup': ['ID=63174eef-3e33-438d-a435-e3f28b518bec,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:42.858397 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:42.865210 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-58985949-ca30-4f48-9c27-f2cae8091380 req-2ecdf722-9978-4131-a2fd-fd1156552e7e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 210 time: 0.0867486
Jun 02 16:41:42.976281 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.db.resource_extend [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:41:43.026581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.051762 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.057365 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-05040806-31f2-4aa1-b134-b322bf61669d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:43.096304 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c00b3f41-aa34-46fb-8342-0ea46990a666,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:43.105526 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:43.113072 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.117424 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3603005
Jun 02 16:41:43.118121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51370) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:43.123294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:43.127093 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b62a8881-a75f-4964-8350-6d774a8b6656 req-0e6e3290-cb3c-416a-8bc5-5309874418d7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:43.128558 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b62a8881-a75f-4964-8350-6d774a8b6656 req-0e6e3290-cb3c-416a-8bc5-5309874418d7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1531329
Jun 02 16:41:43.138726 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:43.142886 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:43.145841 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:43.158579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:43.179900 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.205809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.220019 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:43.228308 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b62a8881-a75f-4964-8350-6d774a8b6656 req-ff6eb701-fa5b-4623-b0b2-c056650b99b9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0935285
Jun 02 16:41:43.265929 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Transition to ACTIVE for port object 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:43.279718 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'port_id': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'mac_address': 'fa:16:3e:86:e4:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:41:43.282777 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.290641 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.300518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.303630 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:43.313148 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8d8387cb-eae4-4205-aa29-be15d70a23b0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:43.347515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a0c902fe-f94f-4943-a3c2-732ade84cd5b,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:43.358477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:43.368338 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.372343 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51378) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:43.372476 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2530596
Jun 02 16:41:43.377886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:43.384739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:43.389477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:43.393667 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:43.400471 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:43.462916 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.516865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-ebc7bae7-907c-4941-8d5a-665f424ff3e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:43.519918 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-ebc7bae7-907c-4941-8d5a-665f424ff3e4 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.1368797
Jun 02 16:41:43.568532 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Pushing event updated for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:43.574713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:43.575322 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.663794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d15aa5-5a65-4f6a-9063-7d54dd059312 req-344e2ffc-e3f4-483e-8544-8e94dd80eef9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:43.664304 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:43.665509 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b2d15aa5-5a65-4f6a-9063-7d54dd059312 req-344e2ffc-e3f4-483e-8544-8e94dd80eef9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1772025
Jun 02 16:41:43.667429 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.686363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-6b38671a-bd86-458f-a059-32d3144fa2ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:43.687824 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-6b38671a-bd86-458f-a059-32d3144fa2ce service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.1504467
Jun 02 16:41:43.694084 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.695730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Attempting to bind port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:43.696132 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Attempting to bind port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:43.696494 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Attempting to bind port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 on network 2e981188-5c9f-4f7b-87dd-07a67b33db56 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:43.703305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:43.703928 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Checking segment: {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:43.704321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.704715 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Bound using segment: {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:43.705196 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Bound port: 0edec0c6-96bd-4edc-bbb7-22919b9b88b6, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'daa33d4f-6557-48f8-8364-408b98ddd67f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 652, 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:43.705558 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.717969 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:43.723763 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5a1ba250-bfe5-4c6d-8d1c-535ec5585d30 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:43.740696 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b6ddce4-b3d3-42dd-8d47-d7b30dd33d11,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:43.760280 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:43.777156 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.785775 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b2d15aa5-5a65-4f6a-9063-7d54dd059312 req-5c236c44-13eb-4bd4-8451-5c71b7383023 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1087248
Jun 02 16:41:43.802120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.803530 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4297686
Jun 02 16:41:43.806224 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51394) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:43.811651 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:43.827187 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:43.831139 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-2d76fc52-c90d-4922-ac28-1be86a6bd14d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.1100550
Jun 02 16:41:43.838435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:43.852213 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:43.855731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:43.875308 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:43.907718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:43.922533 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:43.925730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:43.998545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] For port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:44.005094 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] For port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:44.011822 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.025997 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:44.105861 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:44.107713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77599130>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:44.108859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-53d1f19e-8f4a-4a16-8f5e-7cbf893a64c8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:44.115693 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-53d1f19e-8f4a-4a16-8f5e-7cbf893a64c8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 814 time: 0.4268923
Jun 02 16:41:44.138353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-4c835e3a-47c1-48fd-88fe-b4a665fea2e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:44.139487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.139990 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-4c835e3a-47c1-48fd-88fe-b4a665fea2e5 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.2509711
Jun 02 16:41:44.161295 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.169381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fae78f4b-489f-4afc-b4bd-44799ad9583d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:44.202747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81b9a121-94c2-4c25-af5c-8904cbc4d17f,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:44.206201 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:44.234054 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-eb3d85ac-166e-4ce4-a112-6ea790722c88 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/quotas/72708e56387e47539c517fd7fe956ea3 HTTP/1.1" status: 200  len: 375 time: 0.1173577
Jun 02 16:41:44.238157 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-0e571999-489e-4e08-930a-f06ebe967759 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0867193
Jun 02 16:41:44.259820 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.262166 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4535220
Jun 02 16:41:44.271754 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e62663-f284-490a-b5f4-afd373702cc5 req-dc84c4c5-2ab6-470f-99fe-a1b2b922dd5a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:44.279174 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-11e62663-f284-490a-b5f4-afd373702cc5 req-dc84c4c5-2ab6-470f-99fe-a1b2b922dd5a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 944 time: 0.2893183
Jun 02 16:41:44.281405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51404) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:44.285976 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:44.291948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:44.296288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:44.300260 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:44.306589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:44.324624 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-0f09e926-a167-4b79-a8fc-b2e257824e9b tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0896151
Jun 02 16:41:44.339833 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.securitygroups_db [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Project 2be2419a57e644b38a5c0ca942660a19 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:41:44.341291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-c0c2a590-0898-4bed-b3d4-9942c1dff5f8 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:44.343201 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-c0c2a590-0898-4bed-b3d4-9942c1dff5f8 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 808 time: 0.4528646
Jun 02 16:41:44.349938 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.399075 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:44.412143 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Request body: {'port': {'device_id': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f', 'admin_state_up': True, 'tenant_id': 'a1836d0c3dbd473ca08d38562b52e19d'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:44.415612 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-11e62663-f284-490a-b5f4-afd373702cc5 req-a9705c6e-349d-4eb7-9dec-773f9b9d9d7b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1355772
Jun 02 16:41:44.457186 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.465852 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.469254 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:44.478437 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Pushing event updated for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:44.489147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.463s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:44.512110 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=945f8dd9-95fb-4392-ace5-d1ce6a1643a5,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:44.516744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:44.529685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.533630 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c6f12b01-1500-4d0f-8669-24c95f125bfc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2487071
Jun 02 16:41:44.533994 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51410) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:44.547631 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'security_group_rule': {'security_group_id': '63174eef-3e33-438d-a435-e3f28b518bec', 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:44.556182 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:44.563517 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:44.593812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:security_group_rule and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:44.601216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:44.606291 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e678e9ee-5fbf-4004-920d-40a6d787ac1f req-19be7c08-c2d5-49ab-ab2c-8ae5539cada7 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 210 time: 0.0519898
Jun 02 16:41:44.610279 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:44.623997 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.securitygroups_db [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Project 2be2419a57e644b38a5c0ca942660a19 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:41:44.641119 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.735502 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.743470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.747635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fb27acf1-513f-483d-b592-e5929cff7876 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:44.786256 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:44.789257 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.2500665
Jun 02 16:41:44.790897 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=186826ad-a5e8-4b0e-b2aa-b383c9f0c3ed,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:44.793887 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e882dc27-8d28-460f-9cd8-f85cf9d94553 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:44.840606 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-971cd746-38bc-4e6a-94c9-69f8b8dce4ec service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5510731
Jun 02 16:41:44.996890 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-570fa74e-8f8d-4f74-ad4d-10f0fa583ec6 service neutron] 10.222.0.25 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6493161
Jun 02 16:41:45.065760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:45.073940 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77599130>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:38Z', 'revision_number': 4, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '0edec0c6-96bd-4edc-bbb7-22919b9b88b6', 'name': '', 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'mac_address': 'fa:16:3e:07:6b:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:36Z', 'updated_at': '2021-06-02T16:41:43Z', 'revision_number': 4, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'subnets': [{'id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:45.075554 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:45.086856 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cee57997-bf75-4f1d-9414-85c9e8b44d4c None None] The sync data for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi is: [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:41:38Z', 'revision_number': 4, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '0edec0c6-96bd-4edc-bbb7-22919b9b88b6', 'name': '', 'network_id': '2e981188-5c9f-4f7b-87dd-07a67b33db56', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'mac_address': 'fa:16:3e:07:6b:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:36Z', 'updated_at': '2021-06-02T16:41:43Z', 'revision_number': 4, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'subnets': [{'id': '866a4c65-75ff-4446-b1dc-0dbfdf1b68a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:45.101148 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Made reservation on behalf of a1836d0c3dbd473ca08d38562b52e19d for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:45.105579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:45.188964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8e1bb8e-392c-4113-a444-202f0e04eb97 req-2cf7b101-5b13-4177-93a2-3a979ec3999b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:45.198278 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a8e1bb8e-392c-4113-a444-202f0e04eb97 req-2cf7b101-5b13-4177-93a2-3a979ec3999b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1443901
Jun 02 16:41:45.225839 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ae3987e-d0d6-45f3-9bce-fb693cfd9d5b req-e5545150-7c18-4a93-8d7e-97256264c67f service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3732841
Jun 02 16:41:45.287816 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a8e1bb8e-392c-4113-a444-202f0e04eb97 req-4c8fdacb-4786-44c5-8455-de1713a2651b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0886214
Jun 02 16:41:45.394228 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-75ece98c-d69e-4002-b7f2-c8a593d8c2ee service neutron] 10.222.0.25 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3958979
Jun 02 16:41:45.492430 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Allocated IP 172.20.0.7 (02df58b0-f30e-4a68-b09a-14d590111b4f/20e402a0-b7ee-4669-88f8-ad03a86eca35/adb58373-96f1-4492-8257-4dcc98dd2072) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:45.543675 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f773301-12ba-43e6-9469-168b6ba6ed70 req-6d00bc9b-eca7-4fe7-84fd-d2fa7ce6380e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:45.551276 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f773301-12ba-43e6-9469-168b6ba6ed70 req-6d00bc9b-eca7-4fe7-84fd-d2fa7ce6380e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1151688
Jun 02 16:41:45.615971 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f773301-12ba-43e6-9469-168b6ba6ed70 req-2ab59af8-daf4-4566-8525-5a266f1bf206 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0636661
Jun 02 16:41:45.986145 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:45.991245 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f9b93e-b02a-4911-a365-810efe07b90c req-88ac27a0-9224-4dc7-b834-731c3701d5c0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:46.010525 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14f9b93e-b02a-4911-a365-810efe07b90c req-88ac27a0-9224-4dc7-b834-731c3701d5c0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 944 time: 0.1825376
Jun 02 16:41:46.022876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:46.039605 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:46.079619 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14f9b93e-b02a-4911-a365-810efe07b90c req-b08f3c10-13f0-4726-834e-94471ee1cf5e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0685606
Jun 02 16:41:46.095821 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Network 02df58b0-f30e-4a68-b09a-14d590111b4f is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:46.127708 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:46.145217 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:46.303478 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a3d6874-5b37-4955-a946-7eb1872d7565 req-ce25a8ba-c8d8-4ebe-999a-23e5c67b1f73 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 210 time: 0.1025453
Jun 02 16:41:46.386449 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:46.387166 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:46.428890 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:46.456492 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Pushing event updated for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:46.468172 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:46.480735 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.0782201
Jun 02 16:41:46.494821 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Request body: {'port': {'device_id': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:46.608945 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:46.615297 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:46.616332 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:46.702812 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:46.723729 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae31361c-b560-42cb-9f2f-ff36b5df385d req-33462115-b082-4161-bf51-b8587067c829 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:46.725591 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ae31361c-b560-42cb-9f2f-ff36b5df385d req-33462115-b082-4161-bf51-b8587067c829 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 931 time: 0.1584435
Jun 02 16:41:46.801721 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ae31361c-b560-42cb-9f2f-ff36b5df385d req-1cc48128-d872-47d6-bd11-e8b0d003b6ca tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0596919
Jun 02 16:41:46.881935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:46.914703 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:46.929955 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:46.930336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:46.970753 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.036888 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:47.048319 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7b47fe-0b06-4dbc-9257-8ac231e669a8 req-14e0db90-60a2-4996-b0ca-ce2caca92852 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:47.050378 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cc7b47fe-0b06-4dbc-9257-8ac231e669a8 req-14e0db90-60a2-4996-b0ca-ce2caca92852 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1251359
Jun 02 16:41:47.063995 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301de952-fd05-45f4-890c-593c08849423 req-b407263e-5ad3-4874-a24e-88b5adf00622 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:47.070819 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.075438 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-301de952-fd05-45f4-890c-593c08849423 req-b407263e-5ad3-4874-a24e-88b5adf00622 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.3031340
Jun 02 16:41:47.078954 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-6867eca9-4fc6-4a69-8703-05c81fac45a4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:47.170250 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.179624 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cc7b47fe-0b06-4dbc-9257-8ac231e669a8 req-7861e2d3-a0c3-465f-8e22-1dfb2ca1177a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1219876
Jun 02 16:41:47.198617 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:47.202096 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:47.206777 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:47.209411 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da01a2b7-eacf-4758-bca8-4b31c8785b37" -d '{"events": [{"server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "name": "network-vif-plugged", "status": "completed", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:47.217446 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:47.223198 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.225879 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:47.282068 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-301de952-fd05-45f4-890c-593c08849423 req-ea5208a1-50ee-43fb-b106-c4eef42d3fa4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2056208
Jun 02 16:41:47.313507 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:47.317357 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:47.345808 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-170dbcb8-a59a-45f0-80be-9b62e00d137f x-openstack-request-id: req-170dbcb8-a59a-45f0-80be-9b62e00d137f {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:47.346199 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "name": "network-vif-plugged", "status": "completed", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:47.346545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-170dbcb8-a59a-45f0-80be-9b62e00d137f {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:47.347029 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'code': 200}
Jun 02 16:41:47.432980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id adb58373-96f1-4492-8257-4dcc98dd2072 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:47.453747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.496775 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9196be-dcd7-491b-9e84-415fb6e1184d req-af1f9e7d-e5fe-4f5a-a63a-1f3e01c9a09c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:47.509429 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-14df478d-888e-4660-94f5-d5d2d6447687 req-0fdeaf08-e181-44b9-9ca2-8c404dfd1cd3 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 210 time: 0.0524428
Jun 02 16:41:47.511391 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac9196be-dcd7-491b-9e84-415fb6e1184d req-af1f9e7d-e5fe-4f5a-a63a-1f3e01c9a09c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1832092
Jun 02 16:41:47.529413 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Transition to ACTIVE for port object adb58373-96f1-4492-8257-4dcc98dd2072 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:47.535549 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:47.540478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:47.564378 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac9196be-dcd7-491b-9e84-415fb6e1184d req-b66179ee-7d52-4d09-b879-174a72c1c26b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0520911
Jun 02 16:41:47.720394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Pushing event updated for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:47.853761 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e74e83-a41d-4223-bfa1-529a096c25d2 req-2ebe04b2-0bd1-48b5-968b-a8400071480a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:47.856582 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-33e74e83-a41d-4223-bfa1-529a096c25d2 req-2ebe04b2-0bd1-48b5-968b-a8400071480a service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1098 time: 0.1178265
Jun 02 16:41:47.913655 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-33e74e83-a41d-4223-bfa1-529a096c25d2 req-2d6305a6-f767-4b9e-b5de-a554807cbd03 service neutron] Synchronizing usage tracker for tenant:90adabc121ea41c8a95252bc1c7291c2 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:47.917017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:47.929099 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-33e74e83-a41d-4223-bfa1-529a096c25d2 req-2d6305a6-f767-4b9e-b5de-a554807cbd03 service neutron] Unset dirty status for tenant:90adabc121ea41c8a95252bc1c7291c2 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:47.930395 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-33e74e83-a41d-4223-bfa1-529a096c25d2 req-2d6305a6-f767-4b9e-b5de-a554807cbd03 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0610180
Jun 02 16:41:48.093500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-7b403f63-f5d6-4d40-84d8-a68421193060 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:48.094877 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-7b403f63-f5d6-4d40-84d8-a68421193060 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 814 time: 0.5240319
Jun 02 16:41:48.122009 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Request body: {'port': {'device_id': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'network_id': '87782ba6-7481-4054-b9f8-31430743d283', 'admin_state_up': True, 'tenant_id': '72708e56387e47539c517fd7fe956ea3'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:48.149057 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Attempting to bind port adb58373-96f1-4492-8257-4dcc98dd2072 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:48.149388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Attempting to bind port adb58373-96f1-4492-8257-4dcc98dd2072 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:48.149740 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Attempting to bind port adb58373-96f1-4492-8257-4dcc98dd2072 on network 02df58b0-f30e-4a68-b09a-14d590111b4f {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:48.177244 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Port adb58373-96f1-4492-8257-4dcc98dd2072 on network 02df58b0-f30e-4a68-b09a-14d590111b4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:48.177564 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Attempting to bind port adb58373-96f1-4492-8257-4dcc98dd2072 on network 02df58b0-f30e-4a68-b09a-14d590111b4f {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:48.236983 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:48.237327 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Checking segment: {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:48.237738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Bound using segment: {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:48.238186 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Bound port: adb58373-96f1-4492-8257-4dcc98dd2072, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:48.238533 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:48.321296 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dfacaa-4126-4c34-8609-0b0c981971c0 req-5e3284e4-f686-4756-ac96-a8e7179cc5d1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:48.322085 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-41dfacaa-4126-4c34-8609-0b0c981971c0 req-5e3284e4-f686-4756-ac96-a8e7179cc5d1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:48.323649 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:48.390703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:48.400407 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-41dfacaa-4126-4c34-8609-0b0c981971c0 req-5e3284e4-f686-4756-ac96-a8e7179cc5d1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:48.402480 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41dfacaa-4126-4c34-8609-0b0c981971c0 req-5e3284e4-f686-4756-ac96-a8e7179cc5d1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 943 time: 0.4524925
Jun 02 16:41:48.404310 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Usage tracker for resource:port and tenant:72708e56387e47539c517fd7fe956ea3 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:48.409812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e942e8-0cc9-4b4a-b047-d68ce0877090 req-fa617c1e-2c8e-405b-8a8b-cf9b9e928c0b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:48.410751 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:48.415898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:48.416269 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:48.417357 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-21e942e8-0cc9-4b4a-b047-d68ce0877090 req-fa617c1e-2c8e-405b-8a8b-cf9b9e928c0b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1130977
Jun 02 16:41:48.419215 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:48.442820 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:48.462636 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-21e942e8-0cc9-4b4a-b047-d68ce0877090 req-58838554-2583-4e6b-b126-f833eafc4b90 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443997
Jun 02 16:41:48.462887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adb58373-96f1-4492-8257-4dcc98dd2072,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:48.476082 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:48.484350 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3f2865a0-4e9f-4ee3-99d8-44c8466ffc81 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:48.522513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Made reservation on behalf of 72708e56387e47539c517fd7fe956ea3 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:48.526636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:48.625457 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41dfacaa-4126-4c34-8609-0b0c981971c0 req-12070408-dd18-4376-9307-83c03ddfe66f tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2081878
Jun 02 16:41:48.626950 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:48.627572 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:48.642634 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] 10.222.0.20 "PUT /v2.0/ports/adb58373-96f1-4492-8257-4dcc98dd2072 HTTP/1.1" status: 200  len: 1093 time: 2.1388230
Jun 02 16:41:48.643734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:48.646739 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8" -d '{"events": [{"name": "network-changed", "server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:48.786268 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4e01d8-5c64-4ed2-b1b0-dd231a6ca8ef req-50458005-273d-43c6-b87a-3d041d8fba0a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:48.787757 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f4e01d8-5c64-4ed2-b1b0-dd231a6ca8ef req-50458005-273d-43c6-b87a-3d041d8fba0a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1661496
Jun 02 16:41:48.828973 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfa66d57-3bbd-4641-9559-19c244b20427 req-b4f7c366-ad78-434f-8f8a-d5ad21be6d3f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 210 time: 0.0764282
Jun 02 16:41:48.839878 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f4e01d8-5c64-4ed2-b1b0-dd231a6ca8ef req-5ede8c89-4caa-4da7-a4a6-e205440facca tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0454242
Jun 02 16:41:48.844728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Pushing event updated for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:48.934942 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.451s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:48.952224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-305292ae-2617-409a-b641-013c4b8cd7af x-openstack-request-id: req-305292ae-2617-409a-b641-013c4b8cd7af {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:48.952531 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:48.952800 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-305292ae-2617-409a-b641-013c4b8cd7af {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:48.953201 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072', 'status': 'completed', 'code': 200}
Jun 02 16:41:49.077889 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-a353d1ca-3a65-4fbd-b9b9-d514be001c1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:49.082868 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-a353d1ca-3a65-4fbd-b9b9-d514be001c1a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 1096 time: 0.4039185
Jun 02 16:41:49.085392 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Allocated IP 172.20.0.8 (87782ba6-7481-4054-b9f8-31430743d283/5c2a516d-6355-4d25-a0bf-a043ecc26f20/16e13b85-2dae-4b3b-bafe-16b18eaa4b57) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:49.202198 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-a42454d1-ddbf-4785-9918-6c87f205b58a service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=adb58373-96f1-4492-8257-4dcc98dd2072 HTTP/1.1" status: 200  len: 217 time: 0.1024313
Jun 02 16:41:49.333206 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66596e6d-ebeb-4bba-bad5-b0cf1b64d9d1 req-db0f1c51-ed46-4370-9b37-9a479e5c25ad tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:49.335456 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-66596e6d-ebeb-4bba-bad5-b0cf1b64d9d1 req-db0f1c51-ed46-4370-9b37-9a479e5c25ad tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.3203766
Jun 02 16:41:49.382948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-cf250420-370b-4df5-9c95-6726e08d5768 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:49.384464 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-cf250420-370b-4df5-9c95-6726e08d5768 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.1556354
Jun 02 16:41:49.397645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-8103537b-199d-4e56-b80c-eae1a9410848 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:49.397645 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-8103537b-199d-4e56-b80c-eae1a9410848 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=20e402a0-b7ee-4669-88f8-ad03a86eca35 HTTP/1.1" status: 200  len: 848 time: 0.1791809
Jun 02 16:41:49.408367 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-65072cd0-459e-4591-9c8b-741948fc50dd tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/quotas/a3af7d82fba84269a3596d85213ae5e2 HTTP/1.1" status: 200  len: 375 time: 0.0165842
Jun 02 16:41:49.494345 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-59cb7888-95da-4000-81b6-d7a382916417 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0841017
Jun 02 16:41:49.516067 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-fa197685-97f1-4efe-8e4a-d98ad61954c0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=02df58b0-f30e-4a68-b09a-14d590111b4f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0648968
Jun 02 16:41:49.518828 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-66596e6d-ebeb-4bba-bad5-b0cf1b64d9d1 req-748a67ab-aed0-407b-b0fd-83ad2cd4d9c1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1740124
Jun 02 16:41:49.628987 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-864c0168-0c1e-4d98-a025-29a02971a1a7 service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1275630
Jun 02 16:41:49.655277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:49.699285 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-b366e4f4-fc46-4dfa-8ae2-3e4e18509315 service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1705382
Jun 02 16:41:49.772611 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-7b2101d1-7dff-489a-806e-86f9cfeb43ec service neutron] 10.222.0.25 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1376190
Jun 02 16:41:49.917756 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:49.970891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-70109542-f23d-47a0-8043-e0d99a426a49 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:50.063454 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c50828d-c070-47c8-92a0-fcf5d0f34b82 req-a6aa43b1-4661-4e9b-b0a2-7e043ff8967f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.065023 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5c50828d-c070-47c8-92a0-fcf5d0f34b82 req-a6aa43b1-4661-4e9b-b0a2-7e043ff8967f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 931 time: 0.0936327
Jun 02 16:41:50.068006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Network 87782ba6-7481-4054-b9f8-31430743d283 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:50.073968 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:50.088476 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:50.126685 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Pushing event updated for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:50.127724 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5c50828d-c070-47c8-92a0-fcf5d0f34b82 req-dd2346ff-5484-46c8-9448-6f74f49bb3a1 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Synchronizing usage tracker for tenant:72708e56387e47539c517fd7fe956ea3 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:50.147362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:50.151791 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-5c50828d-c070-47c8-92a0-fcf5d0f34b82 req-dd2346ff-5484-46c8-9448-6f74f49bb3a1 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Unset dirty status for tenant:72708e56387e47539c517fd7fe956ea3 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:50.153356 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5c50828d-c070-47c8-92a0-fcf5d0f34b82 req-dd2346ff-5484-46c8-9448-6f74f49bb3a1 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0800161
Jun 02 16:41:50.154922 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07b610aa-0352-4f47-aafc-0fa15286c003 req-de5552df-d49f-42ab-821f-19e692823970 service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4489944
Jun 02 16:41:50.189829 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.190497 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:50.227472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5cd0f61-5986-4f61-89ce-886383a93b44 req-0d2ac8a1-a646-427c-bc90-d52b46afe636 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.229807 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e5cd0f61-5986-4f61-89ce-886383a93b44 req-0d2ac8a1-a646-427c-bc90-d52b46afe636 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 943 time: 0.4936759
Jun 02 16:41:50.299984 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f6ca2993-6eff-4429-ba2a-53e3c814f98c req-11565ad2-bca4-428b-8f4e-f197948644a8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 210 time: 0.0607731
Jun 02 16:41:50.317059 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.2043777
Jun 02 16:41:50.342217 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Request body: {'port': {'device_id': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:50.395292 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e5cd0f61-5986-4f61-89ce-886383a93b44 req-49c28de7-40dc-494a-b7aa-5a666f53d0c1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1036932
Jun 02 16:41:50.492511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-9f737b4f-4655-4d6d-bdc1-08d6a8c0f8e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.494372 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-9f737b4f-4655-4d6d-bdc1-08d6a8c0f8e8 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 1096 time: 0.2634692
Jun 02 16:41:50.503186 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:50.517858 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d7586f-ce05-4705-bb2c-0438a1344d30 req-e9f614f0-52e1-42ef-9944-2f4e9f8b3c68 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.519891 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-15d7586f-ce05-4705-bb2c-0438a1344d30 req-e9f614f0-52e1-42ef-9944-2f4e9f8b3c68 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1165969
Jun 02 16:41:50.574228 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-15d7586f-ce05-4705-bb2c-0438a1344d30 req-18828f2b-131c-4e40-8f3c-211b495758af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0484500
Jun 02 16:41:50.771925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e6c8a4d-2500-43a5-80f4-109ae688d083 req-856a881c-3aa4-4b2e-9fdb-89f7cde7af6f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.773352 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9e6c8a4d-2500-43a5-80f4-109ae688d083 req-856a881c-3aa4-4b2e-9fdb-89f7cde7af6f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0913303
Jun 02 16:41:50.838242 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9e6c8a4d-2500-43a5-80f4-109ae688d083 req-c45bfda1-f632-4e0e-baad-952c98a8d132 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0582767
Jun 02 16:41:50.865980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-9a9d080b-ff8c-4dbb-aa5b-d8dc156705d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.867447 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-9a9d080b-ff8c-4dbb-aa5b-d8dc156705d9 service neutron] 10.222.0.20 "GET /v2.0/networks?id=02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 200  len: 909 time: 0.3173928
Jun 02 16:41:50.881192 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ab3231-5db9-414c-98fd-a211ae6743c1 req-d3322659-1e7f-4f2d-9f7b-ad25a140b72a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:50.882686 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c3ab3231-5db9-414c-98fd-a211ae6743c1 req-d3322659-1e7f-4f2d-9f7b-ad25a140b72a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.3089976
Jun 02 16:41:50.981012 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-68272eff-c0f7-4221-b308-14412503d10b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=adb58373-96f1-4492-8257-4dcc98dd2072 HTTP/1.1" status: 200  len: 217 time: 0.0973423
Jun 02 16:41:51.016306 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca540f4d-b111-4dfb-9fd8-06fd02303e5e req-59eecdc7-261e-4a1f-bfdc-3f47dd221a95 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:51.018040 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ca540f4d-b111-4dfb-9fd8-06fd02303e5e req-59eecdc7-261e-4a1f-bfdc-3f47dd221a95 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0814846
Jun 02 16:41:51.027314 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51608) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:51.032589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'floatingip': {'port_id': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:51.110557 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:51.131651 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c3ab3231-5db9-414c-98fd-a211ae6743c1 req-028368c0-f490-4606-9db0-3a9a3edf8c43 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1868994
Jun 02 16:41:51.145885 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-4d588d4a-fe0e-46ee-9c90-43f6ac071880 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:51.147328 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-4d588d4a-fe0e-46ee-9c90-43f6ac071880 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=20e402a0-b7ee-4669-88f8-ad03a86eca35 HTTP/1.1" status: 200  len: 848 time: 0.1145074
Jun 02 16:41:51.245816 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-f6f6a350-15eb-49aa-b53e-2920e997b050 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=02df58b0-f30e-4a68-b09a-14d590111b4f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0830534
Jun 02 16:41:51.324120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:51.441429 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:51.514414 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Transition to ACTIVE for port object 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:51.526458 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-c0cb466b-8c2f-4146-ab87-d2c3fb1f9cc5 service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2586315
Jun 02 16:41:51.529281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:51.535542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:51.753460 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-10d8038e-e69b-4a97-ab01-1f39c2cde289 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:51.755365 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-10d8038e-e69b-4a97-ab01-1f39c2cde289 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 814 time: 0.2670903
Jun 02 16:41:51.835574 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Request body: {'port': {'device_id': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'admin_state_up': True, 'tenant_id': 'a3af7d82fba84269a3596d85213ae5e2'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:51.906051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417bd3cb-3084-4bfb-b380-b25eeee49a74 req-08952b90-5f57-4c1d-996e-bea46431e77e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:51.907366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-417bd3cb-3084-4bfb-b380-b25eeee49a74 req-08952b90-5f57-4c1d-996e-bea46431e77e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Synchronizing usage tracker for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:51.910369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Pushing event updated for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:51.919842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:52.052779 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-417bd3cb-3084-4bfb-b380-b25eeee49a74 req-08952b90-5f57-4c1d-996e-bea46431e77e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Unset dirty status for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:52.053980 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-417bd3cb-3084-4bfb-b380-b25eeee49a74 req-08952b90-5f57-4c1d-996e-bea46431e77e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 931 time: 0.6740682
Jun 02 16:41:52.062415 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eb4031c1-5174-4004-a4d8-91c9cc9390e0 req-a552aa33-bff9-4f66-b442-ef795b1b300f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 210 time: 0.0929413
Jun 02 16:41:52.062603 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76a9e6da-6ad3-4117-97d7-5f9da109b0e8 req-2bd8fca2-f196-4f96-9a5c-a3026e31e64c service neutron] 10.222.0.20 "GET /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4873197
Jun 02 16:41:52.116301 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Attempting to bind port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:52.116659 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Attempting to bind port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:52.116968 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Attempting to bind port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 on network 87782ba6-7481-4054-b9f8-31430743d283 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:52.125418 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 on network 87782ba6-7481-4054-b9f8-31430743d283 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:52.125730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Attempting to bind port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 on network 87782ba6-7481-4054-b9f8-31430743d283 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:52.130107 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-417bd3cb-3084-4bfb-b380-b25eeee49a74 req-6d24949f-3d9d-4cd9-8ae1-4e95ef3abade tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0667853
Jun 02 16:41:52.134984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:52.135377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Checking segment: {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:52.135760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Bound using segment: {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:52.136184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Bound port: 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:52.136529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.255771 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:52.260929 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:52.296466 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.304646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:52.310832 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.db.resource_extend [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:41:52.366777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:52.366777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.368046 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] 10.222.0.20 "PUT /v2.0/ports/16e13b85-2dae-4b3b-bafe-16b18eaa4b57 HTTP/1.1" status: 200  len: 1093 time: 2.0336289
Jun 02 16:41:52.370955 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:52.373304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1cb855d4-522b-4fe1-b3ce-65c780007339" -d '{"events": [{"name": "network-changed", "server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:52.421916 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Pushing event updated for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:52.425158 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:52.438955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:52.445127 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.455636 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.486436 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb1409d-2d07-4106-bec7-ac4fba95e826 req-111c85bd-4148-41a6-82a1-863a7bddee63 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:52.487916 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fcb1409d-2d07-4106-bec7-ac4fba95e826 req-111c85bd-4148-41a6-82a1-863a7bddee63 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.2296414
Jun 02 16:41:52.507024 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:52.549411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Made reservation on behalf of a3af7d82fba84269a3596d85213ae5e2 for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:41:52.549770 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fcb1409d-2d07-4106-bec7-ac4fba95e826 req-78023bbd-9691-44b1-b57c-8c4f25771602 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0558777
Jun 02 16:41:52.552485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-b1a67b5a-81b9-4296-9368-ac87985ed30b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:52.552862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:52.553919 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-b1a67b5a-81b9-4296-9368-ac87985ed30b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 1096 time: 0.1261277
Jun 02 16:41:52.577590 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a0955f-da8d-4376-a02c-77ffc8cb0100 req-e26347bb-7044-43ce-8f73-ae4205ac980b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:52.579829 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e5a0955f-da8d-4376-a02c-77ffc8cb0100 req-e26347bb-7044-43ce-8f73-ae4205ac980b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 943 time: 0.3327687
Jun 02 16:41:52.638010 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aad58941-c1cc-41a9-80bd-6fc37f377f99 x-openstack-request-id: req-aad58941-c1cc-41a9-80bd-6fc37f377f99 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:52.638346 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:52.638798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-aad58941-c1cc-41a9-80bd-6fc37f377f99 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:52.639357 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57', 'status': 'completed', 'code': 200}
Jun 02 16:41:52.648426 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-2d123bbd-40ec-4978-803d-ee884c9d6d1d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57 HTTP/1.1" status: 200  len: 217 time: 0.0742259
Jun 02 16:41:52.720258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-34176a43-501b-43fd-b3ef-0ee25545f755 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:52.722294 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-34176a43-501b-43fd-b3ef-0ee25545f755 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5c2a516d-6355-4d25-a0bf-a043ecc26f20 HTTP/1.1" status: 200  len: 854 time: 0.0640585
Jun 02 16:41:52.758649 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adb58373-96f1-4492-8257-4dcc98dd2072 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:41:52.775453 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-49d4918e-0fb0-4b52-8b05-1b9790b4dcad service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87782ba6-7481-4054-b9f8-31430743d283&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0411599
Jun 02 16:41:52.855988 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Floating IP 453ca265-eca3-45c8-8852-538cc3de6dee associated. External IP: 172.27.0.177, port: 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8.
Jun 02 16:41:52.906838 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adb58373-96f1-4492-8257-4dcc98dd2072,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:52.923804 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'adb58373-96f1-4492-8257-4dcc98dd2072', 'network_id': '02df58b0-f30e-4a68-b09a-14d590111b4f', 'port_id': 'adb58373-96f1-4492-8257-4dcc98dd2072', 'mac_address': 'fa:16:3e:53:35:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 654, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20e402a0-b7ee-4669-88f8-ad03a86eca35', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:41:52.925248 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-38e5797c-eac6-4a1d-9ba4-f67703656132 service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1361442
Jun 02 16:41:52.950646 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e5a0955f-da8d-4376-a02c-77ffc8cb0100 req-c88e9582-9444-4d67-9de8-a3c72cc25bcc tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2128084
Jun 02 16:41:52.982867 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:53.000081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id adb58373-96f1-4492-8257-4dcc98dd2072 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:53.022668 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adb58373-96f1-4492-8257-4dcc98dd2072,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:53.028646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:53.031141 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:53.108998 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-87aa8276-b9df-445c-93c5-1c699b3df3d7 req-df5d7842-8c3b-47c3-9702-de42b87b9c7b service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1715763
Jun 02 16:41:53.151702 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Allocated IP 172.20.0.10 (87543dfa-9cef-40b2-b537-1f95fcf2b066/409c7043-b3b6-42f7-90b5-f7db5d717e70/0661c8ef-63c2-44b7-97e0-75589941047e) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:41:53.228828 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:53.232452 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:53.278735 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d65df1b2-55a5-4f98-b2b6-5c3659c7bde0 req-e23fe09c-835e-4d66-878d-ebf3832b9627 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 210 time: 0.0584364
Jun 02 16:41:53.310609 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-b20cea18-1982-441a-9b07-816de5630516 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:53.312451 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-b20cea18-1982-441a-9b07-816de5630516 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 1096 time: 0.1407452
Jun 02 16:41:53.460227 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-5aa90f27-bed4-44da-9aa5-b1619e5939b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:53.461871 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-5aa90f27-bed4-44da-9aa5-b1619e5939b4 service neutron] 10.222.0.20 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 915 time: 0.1318953
Jun 02 16:41:53.491043 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:41:53.514908 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['adb58373-96f1-4492-8257-4dcc98dd2072'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:53.538190 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-5cd186e2-8a75-46eb-981b-aab82502af2b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57 HTTP/1.1" status: 200  len: 217 time: 0.0684600
Jun 02 16:41:53.610980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-8a07c787-f0b2-47e7-9620-4f42bc56d37c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:53.612590 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-8a07c787-f0b2-47e7-9620-4f42bc56d37c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5c2a516d-6355-4d25-a0bf-a043ecc26f20 HTTP/1.1" status: 200  len: 854 time: 0.0611310
Jun 02 16:41:53.646234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64dd99a6-8fc1-430b-aa06-28b6e0e091a4 req-d34cd9ca-ff58-4d84-9247-75dca7b282c4 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:53.653307 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-64dd99a6-8fc1-430b-aa06-28b6e0e091a4 req-d34cd9ca-ff58-4d84-9247-75dca7b282c4 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 943 time: 0.3709931
Jun 02 16:41:53.689033 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-d292b5f7-9b90-491b-88b1-22dd1b376722 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87782ba6-7481-4054-b9f8-31430743d283&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0600531
Jun 02 16:41:53.740722 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:53.814046 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-64dd99a6-8fc1-430b-aa06-28b6e0e091a4 req-86a6917f-4c70-4807-96dc-59a2d5e78eca tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1598091
Jun 02 16:41:53.863029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:41:53.878725 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:41:53.879845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:53.889237 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:53.890092 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c273dc0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:53.932177 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:53.939952 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:53.973769 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-709ca43f-3d01-4a1b-84b7-d5fc50b958cd service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1529474
Jun 02 16:41:53.982470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d24736-dee2-4118-b6ba-091665543dce req-11d420d1-5a4e-496c-948d-0fc5423c6fb3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:53.983398 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b9d24736-dee2-4118-b6ba-091665543dce req-11d420d1-5a4e-496c-948d-0fc5423c6fb3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.2925150
Jun 02 16:41:54.025903 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Network 87543dfa-9cef-40b2-b537-1f95fcf2b066 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:41:54.031027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:41:54.036450 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-0f0bd80e-64f2-4502-873a-887904d126bb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "PUT /v2.0/floatingips/453ca265-eca3-45c8-8852-538cc3de6dee HTTP/1.1" status: 200  len: 991 time: 3.0055368
Jun 02 16:41:54.036450 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:41:54.061918 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:54.064242 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4" -d '{"events": [{"name": "network-changed", "server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:54.072827 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event updated for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:54.079613 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:54.096214 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b9d24736-dee2-4118-b6ba-091665543dce req-0468ce45-125e-41f0-9380-5f5cda980f90 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0894473
Jun 02 16:41:54.120160 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:54.128872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:54.134253 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:54.222774 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.4100692
Jun 02 16:41:54.266542 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Request body: {'port': {'device_id': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:41:54.282917 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1cb855d4-522b-4fe1-b3ce-65c780007339 req-9f684614-f72f-4daf-a1fe-c5c6cc6dd668 service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2985117
Jun 02 16:41:54.354171 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37ac68e-e885-4722-b796-8bb3efb62d45 req-4e8b16a7-7ce9-4612-9f33-ed10a95e2f9e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:54.355705 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c37ac68e-e885-4722-b796-8bb3efb62d45 req-4e8b16a7-7ce9-4612-9f33-ed10a95e2f9e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 944 time: 0.2148874
Jun 02 16:41:54.412081 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a32143f-fea5-4198-8144-038b8a3b9a17 x-openstack-request-id: req-2a32143f-fea5-4198-8144-038b8a3b9a17 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:54.412471 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:54.412664 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-2a32143f-fea5-4198-8144-038b8a3b9a17 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:54.413087 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'status': 'completed', 'code': 200}
Jun 02 16:41:54.471670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:54.531984 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3', 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', '25af827a-b3ac-4754-ac1f-451d6179e2f4'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:54.548945 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-99c31299-c442-41eb-81ef-0c5d809f10d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:54.550506 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-99c31299-c442-41eb-81ef-0c5d809f10d3 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1098 time: 0.1175549
Jun 02 16:41:54.620931 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c273dc0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '453ca265-eca3-45c8-8852-538cc3de6dee', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.177', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 326, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:86:e4:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:41:26Z', 'updated_at': '2021-06-02T16:41:52Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:54.627428 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c37ac68e-e885-4722-b796-8bb3efb62d45 req-a1361e39-78db-4449-9835-96a2dbef6cbb tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2636065
Jun 02 16:41:54.630830 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:41:54.649481 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:41:54.650317 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c273dc0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:41:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:54.704962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a768b50-6aa5-400d-a52c-656a3e5e9dc8 req-cad3e82c-167d-4ac2-a5d5-b85574abf9aa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:54.706585 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9a768b50-6aa5-400d-a52c-656a3e5e9dc8 req-cad3e82c-167d-4ac2-a5d5-b85574abf9aa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 932 time: 0.2050233
Jun 02 16:41:54.756660 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-2a585afa-c9cd-4216-bc0c-d32beb667cdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:54.765629 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-2a585afa-c9cd-4216-bc0c-d32beb667cdb service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1985366
Jun 02 16:41:54.769331 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adb58373-96f1-4492-8257-4dcc98dd2072 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:41:54.865576 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9a768b50-6aa5-400d-a52c-656a3e5e9dc8 req-f2350e45-6da1-48f8-b53c-d5355b3b2931 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1413214
Jun 02 16:41:54.902242 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-50de74e5-d940-4926-887f-e3f614a9f9f4 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 999 time: 0.1343777
Jun 02 16:41:54.942378 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:41:54.951435 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port adb58373-96f1-4492-8257-4dcc98dd2072 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:41:54.959713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port adb58373-96f1-4492-8257-4dcc98dd2072 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:41:54.960444 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.030307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-6848ddfa-eb28-4f94-903f-af0728ab46cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:55.031795 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-6848ddfa-eb28-4f94-903f-af0728ab46cb service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.1175942
Jun 02 16:41:55.131764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-8bace452-2fa8-4b89-9919-79fdb996df1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:55.133312 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-8bace452-2fa8-4b89-9919-79fdb996df1c service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0941823
Jun 02 16:41:55.180594 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ee309be-e086-4c4d-97e3-a6af5cceb191 req-a47c1cdd-4dcc-4566-bfad-bb3de4a818c8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:55.182098 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7ee309be-e086-4c4d-97e3-a6af5cceb191 req-a47c1cdd-4dcc-4566-bfad-bb3de4a818c8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 943 time: 0.1707301
Jun 02 16:41:55.216810 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0661c8ef-63c2-44b7-97e0-75589941047e {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:55.230213 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.258648 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.303250 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7ee309be-e086-4c4d-97e3-a6af5cceb191 req-4ce5ad89-e6ac-49ef-8d36-cb4f3616bf70 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1133332
Jun 02 16:41:55.321397 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Transition to ACTIVE for port object 0661c8ef-63c2-44b7-97e0-75589941047e will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:41:55.327845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.334013 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:55.349771 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:55.354875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccc6abe8-788d-4499-8832-736cf37601ea" -d '{"events": [{"server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "name": "network-vif-plugged", "status": "completed", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:55.367717 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adb58373-96f1-4492-8257-4dcc98dd2072,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:55.375511 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.387516 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:55.492542 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:55.501058 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.501690 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.502913 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.503419 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.503910 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.504379 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.504840 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.505307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.505844 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.506317 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.506781 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.507451 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:41:55.528938 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:55.563054 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-cb285e66-c2ff-4ce1-9811-a03abf8fa64b service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4180226
Jun 02 16:41:55.567291 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c273dc0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '453ca265-eca3-45c8-8852-538cc3de6dee', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.177', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 326, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:86:e4:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:41:26Z', 'updated_at': '2021-06-02T16:41:52Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:41:55.569706 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Pushing event updated for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:55.574244 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120f9a6-562f-432e-953f-baade26e18ee None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '453ca265-eca3-45c8-8852-538cc3de6dee', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.177', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 326, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:86:e4:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:41:26Z', 'updated_at': '2021-06-02T16:41:52Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:41:55.580987 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:55.614664 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d23932b-0c28-45d7-b153-6c27a3c23de7 x-openstack-request-id: req-2d23932b-0c28-45d7-b153-6c27a3c23de7 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:55.615177 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "name": "network-vif-plugged", "status": "completed", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:55.615259 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-2d23932b-0c28-45d7-b153-6c27a3c23de7 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:55.615610 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072', 'code': 200}
Jun 02 16:41:55.643459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1865784b-d39f-44a7-9647-320a1fdb16a9 req-4c744a22-e5c0-42ad-8081-916765118cd2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:55.651228 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1865784b-d39f-44a7-9647-320a1fdb16a9 req-4c744a22-e5c0-42ad-8081-916765118cd2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.3196881
Jun 02 16:41:55.703608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Attempting to bind port 0661c8ef-63c2-44b7-97e0-75589941047e on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:41:55.704616 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Attempting to bind port 0661c8ef-63c2-44b7-97e0-75589941047e by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:41:55.705118 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Attempting to bind port 0661c8ef-63c2-44b7-97e0-75589941047e on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:55.711448 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Port 0661c8ef-63c2-44b7-97e0-75589941047e on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:41:55.712120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Attempting to bind port 0661c8ef-63c2-44b7-97e0-75589941047e on network 87543dfa-9cef-40b2-b537-1f95fcf2b066 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:41:55.723334 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:41:55.724589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Checking segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:41:55.727061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Bound using segment: {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:41:55.728247 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Bound port: 0661c8ef-63c2-44b7-97e0-75589941047e, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '59c8b886-b320-4458-b689-37f87c2bd654', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 679, 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:41:55.728771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.782780 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1865784b-d39f-44a7-9647-320a1fdb16a9 req-7b6b90e0-bb41-4552-a207-ce7f1564ef9d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1276386
Jun 02 16:41:55.822318 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cec9eb75-d1f7-4904-8cd9-e684ec6587e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.833428 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56e582a0-b682-41c7-9c80-a4f7ebcf59d4 req-26378980-3e44-4855-8c9f-39c8c711b5fa service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2626204
Jun 02 16:41:55.938095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:41:55.956524 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0661c8ef-63c2-44b7-97e0-75589941047e,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:41:55.971841 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:55.976797 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5631530-a1d7-4179-a541-ab30960e8705 None None] New status for floating IP 453ca265-eca3-45c8-8852-538cc3de6dee: ACTIVE {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:41:56.000059 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:56.108066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.108881 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:56.110405 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] 10.222.0.20 "PUT /v2.0/ports/0661c8ef-63c2-44b7-97e0-75589941047e HTTP/1.1" status: 200  len: 1094 time: 1.8625798
Jun 02 16:41:56.144449 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871c77dc-04b9-45e7-8f24-1faf431d064a req-e8d8c141-a8ff-4b7d-aa76-01b0014b94c8 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.151476 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-871c77dc-04b9-45e7-8f24-1faf431d064a req-e8d8c141-a8ff-4b7d-aa76-01b0014b94c8 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.2642150
Jun 02 16:41:56.168996 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Pushing event updated for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:56.186460 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe4dbf7-1c02-4bfa-911b-5cc2517457e4 req-c23f65fb-65be-482e-98ec-3e75751814d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.189645 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7fe4dbf7-1c02-4bfa-911b-5cc2517457e4 req-c23f65fb-65be-482e-98ec-3e75751814d0 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 1098 time: 0.2131162
Jun 02 16:41:56.210589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:56.255059 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-871c77dc-04b9-45e7-8f24-1faf431d064a req-fd6a366c-2ad5-4900-b644-8437fbacf816 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1024346
Jun 02 16:41:56.282068 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7fe4dbf7-1c02-4bfa-911b-5cc2517457e4 req-20d9a657-3c40-4060-bae8-46e0bad1a6d2 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0849853
Jun 02 16:41:56.298586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-eb069ca2-3915-4ee4-9cd7-08db4723cd9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.300676 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-eb069ca2-3915-4ee4-9cd7-08db4723cd9d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 1097 time: 0.1252737
Jun 02 16:41:56.460298 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d77301-a0a8-4cc2-9268-f7ecc7135ccb req-8a287dde-ee48-4c42-bc22-fd0abecb6e7b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.461895 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56d77301-a0a8-4cc2-9268-f7ecc7135ccb req-8a287dde-ee48-4c42-bc22-fd0abecb6e7b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 944 time: 0.1503580
Jun 02 16:41:56.464726 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:41:56.467245 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50ff6557-fa8f-4143-83ed-6680c60dc402" -d '{"events": [{"name": "network-changed", "server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:41:56.530458 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-37befec2-5ff1-4de1-a457-a56fe8b8eda1 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0661c8ef-63c2-44b7-97e0-75589941047e HTTP/1.1" status: 200  len: 217 time: 0.1899061
Jun 02 16:41:56.535802 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56d77301-a0a8-4cc2-9268-f7ecc7135ccb req-fa81de5c-87f3-4197-bbd6-1c249d87eb65 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599208
Jun 02 16:41:56.632163 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739f1b3e-6ba3-407d-9a6c-44cc9743c3cd req-445f31c6-e2fb-4977-bf7e-dcf746219160 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.633707 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-739f1b3e-6ba3-407d-9a6c-44cc9743c3cd req-445f31c6-e2fb-4977-bf7e-dcf746219160 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 943 time: 0.1622550
Jun 02 16:41:56.637251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:41:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-083a2c89-849f-4b06-bc32-f9d4bef32848 x-openstack-request-id: req-083a2c89-849f-4b06-bc32-f9d4bef32848 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:41:56.637567 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:41:56.637886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-083a2c89-849f-4b06-bc32-f9d4bef32848 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:41:56.638389 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e', 'status': 'completed', 'code': 200}
Jun 02 16:41:56.639920 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-d148f5f5-b3f4-43d4-b71a-febbd7ceacc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:56.641311 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-d148f5f5-b3f4-43d4-b71a-febbd7ceacc6 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1044853
Jun 02 16:41:56.706960 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-4a661dd3-976f-48cb-98b0-ac78061ad996 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0510216
Jun 02 16:41:56.746882 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-739f1b3e-6ba3-407d-9a6c-44cc9743c3cd req-4254e8c7-0614-4c8f-9df7-f04d41efb7b4 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1046000
Jun 02 16:41:56.766420 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:41:56.871995 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-bd8dad9d-8dbc-4b16-a48d-ce46c630b99e service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1521318
Jun 02 16:41:56.910401 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:56.926081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57', 'network_id': '87782ba6-7481-4054-b9f8-31430743d283', 'port_id': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57', 'mac_address': 'fa:16:3e:c0:eb:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5c2a516d-6355-4d25-a0bf-a043ecc26f20', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:41:56.992996 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:57.011255 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:41:57.030090 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:41:57.035042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:57.036988 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9405c895-5299-4044-9065-fba430ec7898 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:57.102377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:57.105838 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:57.164959 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a0bc488-7366-4cc1-b54e-fc10f9e3cead req-fd74c244-7f61-46ff-ab3c-4467930f8160 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2820623
Jun 02 16:41:57.182422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65862f7-3412-4eb6-b66b-72e6275d091f req-67cc7a93-b5c0-416e-90fb-69365e8246ed tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.183739 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b65862f7-3412-4eb6-b66b-72e6275d091f req-67cc7a93-b5c0-416e-90fb-69365e8246ed tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.2596736
Jun 02 16:41:57.231465 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b65862f7-3412-4eb6-b66b-72e6275d091f req-fa9d0a71-eb6a-4221-a509-60f76f452163 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406823
Jun 02 16:41:57.304396 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-f0c2e053-91d1-4222-bca9-987b484a42fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.305921 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-f0c2e053-91d1-4222-bca9-987b484a42fd service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=a3af7d82fba84269a3596d85213ae5e2&device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 1097 time: 0.0731623
Jun 02 16:41:57.445512 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-619cc044-71fa-4871-996b-d26d244ed3f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.446881 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-619cc044-71fa-4871-996b-d26d244ed3f4 service neutron] 10.222.0.20 "GET /v2.0/networks?id=87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 200  len: 915 time: 0.1318717
Jun 02 16:41:57.462808 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0b6d0b-cd4c-4bc3-ab13-00bc53a7c99f req-68d63652-e795-4c92-8f5d-2c6176868fa1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.464302 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a0b6d0b-cd4c-4bc3-ab13-00bc53a7c99f req-68d63652-e795-4c92-8f5d-2c6176868fa1 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.0903494
Jun 02 16:41:57.516100 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['16e13b85-2dae-4b3b-bafe-16b18eaa4b57'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:41:57.534837 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-d3620753-8349-4791-ad6a-59f8cd960461 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0661c8ef-63c2-44b7-97e0-75589941047e HTTP/1.1" status: 200  len: 217 time: 0.0748796
Jun 02 16:41:57.625892 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a0b6d0b-cd4c-4bc3-ab13-00bc53a7c99f req-6d3a06e5-c0b3-4df6-abb3-4ad38d974110 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1555660
Jun 02 16:41:57.696336 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-3dbf0ed4-7a8e-4ef4-a4d8-da786002ae4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.698197 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-3dbf0ed4-7a8e-4ef4-a4d8-da786002ae4c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 200  len: 854 time: 0.1353216
Jun 02 16:41:57.815548 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-779aff7b-8118-46a5-a315-0e20ba8cd1d5 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87543dfa-9cef-40b2-b537-1f95fcf2b066&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1001024
Jun 02 16:41:57.944931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c57556fe-2823-42af-a4ad-0d7adccb48ac req-46a131c2-0345-495a-8b6c-0dbbebb3f5cd tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.946655 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c57556fe-2823-42af-a4ad-0d7adccb48ac req-46a131c2-0345-495a-8b6c-0dbbebb3f5cd tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 944 time: 0.0827408
Jun 02 16:41:57.979291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e69ade4-8f1a-4e65-b60f-a8500c63f906 req-cc3b42c0-4dc6-4648-9b1c-e6f51d6be1c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:57.980008 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-3e69ade4-8f1a-4e65-b60f-a8500c63f906 req-cc3b42c0-4dc6-4648-9b1c-e6f51d6be1c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:41:57.995763 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 51724) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:58.002237 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c57556fe-2823-42af-a4ad-0d7adccb48ac req-9e113451-878c-46c5-a12a-e8d089730b36 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490820
Jun 02 16:41:58.031887 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-4e2968d7-ae21-4ea2-9913-05cf67daebc2 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1960783
Jun 02 16:41:58.032941 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-3e69ade4-8f1a-4e65-b60f-a8500c63f906 req-cc3b42c0-4dc6-4648-9b1c-e6f51d6be1c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:41:58.033990 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e69ade4-8f1a-4e65-b60f-a8500c63f906 req-cc3b42c0-4dc6-4648-9b1c-e6f51d6be1c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 944 time: 0.2690740
Jun 02 16:41:58.125116 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e69ade4-8f1a-4e65-b60f-a8500c63f906 req-0be75a97-e59a-4c39-85dc-63e86c70d867 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0841453
Jun 02 16:41:58.195199 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.225582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:41:58.237377 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Usage tracker for resource:security_group_rule and tenant:e3a25814a3c44c5490da74572d7498ad is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:41:58.241243 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:41:58.245396 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-50ff6557-fa8f-4143-83ed-6680c60dc402 req-a2933fd6-dc84-49ab-a697-1ad516bc9339 service neutron] 10.222.0.20 "GET /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1907141
Jun 02 16:41:58.248951 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:41:58.337412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.344588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.358458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-177c34ec-d18c-4436-a615-b8bcc5ee072e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:58.437886 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e3a25814a3c44c5490da74572d7498ad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4386635
Jun 02 16:41:58.440738 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca7053d0-f540-43ae-b6bf-04f7da1c3bc6,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:58.440891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51732) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:41:58.444044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:58.479644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-55fc2ee0-6b74-41fe-bc74-0ada170df932 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.483603 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c49d43-42c7-4257-8a3b-b8dcdddcdf68 req-d02cd558-86d1-4d1b-a0e5-d09a8d132dfb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:58.485205 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93c49d43-42c7-4257-8a3b-b8dcdddcdf68 req-d02cd558-86d1-4d1b-a0e5-d09a8d132dfb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1292012
Jun 02 16:41:58.505128 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.531713 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.533355 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93c49d43-42c7-4257-8a3b-b8dcdddcdf68 req-ef2bdecd-714b-4178-b40f-b8ee115d5c62 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424447
Jun 02 16:41:58.596639 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.600523 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-7fa678b1-5483-43ce-a2ec-6157b963cf9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:41:58.613656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca7053d0-f540-43ae-b6bf-04f7da1c3bc6,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:41:58.616966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:41:58.619111 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.622681 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ca7053d0-f540-43ae-b6bf-04f7da1c3bc6 HTTP/1.1" status: 204  len: 168 time: 0.1783912
Jun 02 16:41:58.748090 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:41:58.835278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb96ff30-8a22-4d5c-8370-c91f7016630b req-fc0238e4-ebd8-48db-ab3c-06469f3416c0 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:58.838402 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cb96ff30-8a22-4d5c-8370-c91f7016630b req-fc0238e4-ebd8-48db-ab3c-06469f3416c0 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.0878191
Jun 02 16:41:58.889045 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cb96ff30-8a22-4d5c-8370-c91f7016630b req-d194a215-26cd-4729-8a6d-a5a3ee521970 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445209
Jun 02 16:41:58.938919 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-811ba5b6-4880-479a-8cd0-e08a258a14de service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0985534
Jun 02 16:41:59.047843 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-bb09fbb1-04b1-493f-ac0d-f948e6e3d76f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.049298 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-bb09fbb1-04b1-493f-ac0d-f948e6e3d76f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.0771899
Jun 02 16:41:59.309083 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-f1aaa9ff-5546-487f-9a45-2a7f059e4dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.310877 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-f1aaa9ff-5546-487f-9a45-2a7f059e4dd6 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.2339945
Jun 02 16:41:59.408496 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-4b375df0-fa0f-403f-b7d5-2462ee03f81a service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.0879996
Jun 02 16:41:59.414503 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0cd5b96-14a5-4fa7-b5bb-5fc73dcdeb12 req-dfa72b21-19b3-47b2-b430-bc2fe250c9ff tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.416560 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d0cd5b96-14a5-4fa7-b5bb-5fc73dcdeb12 req-dfa72b21-19b3-47b2-b430-bc2fe250c9ff tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 944 time: 0.1459093
Jun 02 16:41:59.527619 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d0cd5b96-14a5-4fa7-b5bb-5fc73dcdeb12 req-f4442cca-542d-4216-8874-eab2da33f8fe tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1033585
Jun 02 16:41:59.553982 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:41:59.628679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0e035a-3d58-4ad8-b2b4-9737baeefe20 req-57335b56-9243-451d-a085-efca8adbf7f5 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.634128 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac0e035a-3d58-4ad8-b2b4-9737baeefe20 req-57335b56-9243-451d-a085-efca8adbf7f5 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 944 time: 0.4596226
Jun 02 16:41:59.687235 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-5fe28445-5701-4373-baae-e054ca6f31d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.688666 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-5fe28445-5701-4373-baae-e054ca6f31d0 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.2709594
Jun 02 16:41:59.696398 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac0e035a-3d58-4ad8-b2b4-9737baeefe20 req-04c71385-8a4d-4203-aba2-ba638cfe5f64 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0579107
Jun 02 16:41:59.740857 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-dfe93dcd-e6ca-4a39-b73b-6e952aff0861 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0420051
Jun 02 16:41:59.969057 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-f1019a85-1938-4a2f-9a65-de8e417132be service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2174361
Jun 02 16:41:59.986432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd57a677-a2a7-41a4-8eee-a43095950c7d req-534d37be-1a44-4a68-8fe5-c8811877d42a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:41:59.986754 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cd57a677-a2a7-41a4-8eee-a43095950c7d req-534d37be-1a44-4a68-8fe5-c8811877d42a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1347303
Jun 02 16:42:00.144677 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cd57a677-a2a7-41a4-8eee-a43095950c7d req-e5f29d92-0686-45b6-8718-52b72871a888 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1370974
Jun 02 16:42:00.185169 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-12320f2f-0608-44c1-8feb-a8a7a9a570bc req-d3dcdda9-56ea-4d13-b289-5f795f14a0bf service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1972420
Jun 02 16:42:00.188970 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:00.493470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51808) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:00.507880 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0473cfe3-0c7e-4e9a-a32c-900f4ed4b63f req-dcab19af-fa5b-48b3-8f9a-c040bcb0d90e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:00.509480 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0473cfe3-0c7e-4e9a-a32c-900f4ed4b63f req-dcab19af-fa5b-48b3-8f9a-c040bcb0d90e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.1010585
Jun 02 16:42:00.571270 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0473cfe3-0c7e-4e9a-a32c-900f4ed4b63f req-758e1f1e-e25b-4797-b2ee-fce84000552f tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0527401
Jun 02 16:42:00.663202 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:00.679374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:42:00.683540 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Usage tracker for resource:security_group_rule and tenant:a8a056ac7c464dc19d6c246b02637350 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:42:00.687019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:42:00.695483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:42:00.809021 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 0661c8ef-63c2-44b7-97e0-75589941047e details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:42:00.842049 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-5c75e784-feac-4ab0-84a8-0066b0f05c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:00.843532 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-5c75e784-feac-4ab0-84a8-0066b0f05c0d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.1568501
Jun 02 16:42:00.856592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9678ef-3f1b-4e46-ac3a-53c0dea399c4 req-24edce65-b2eb-4e17-939b-9da20fdb2efa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:00.858202 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0f9678ef-3f1b-4e46-ac3a-53c0dea399c4 req-24edce65-b2eb-4e17-939b-9da20fdb2efa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1109374
Jun 02 16:42:00.865890 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414249e6-6c9c-4c4c-acc4-8d512a840755 req-dab937b3-6624-4036-8f58-56237d82b23f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:00.867509 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-414249e6-6c9c-4c4c-acc4-8d512a840755 req-dab937b3-6624-4036-8f58-56237d82b23f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 944 time: 0.1416261
Jun 02 16:42:00.871581 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:42:00.904674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:00.922478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:00.933007 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ca691dbb-8346-47eb-8a51-7d2dd2a85552 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:00.947872 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-414249e6-6c9c-4c4c-acc4-8d512a840755 req-000082df-7fef-4b01-995e-0c2d7a38174e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0669065
Jun 02 16:42:00.983657 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a8a056ac7c464dc19d6c246b02637350&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4889741
Jun 02 16:42:00.985239 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 51822) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:00.996299 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4256726-4e7f-4c02-a6d1-08eac0063951,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:01.001633 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:01.040373 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0f9678ef-3f1b-4e46-ac3a-53c0dea399c4 req-f87c4140-3210-4bb5-980f-bba021bf22f6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1631458
Jun 02 16:42:01.066292 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0661c8ef-63c2-44b7-97e0-75589941047e,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:01.072212 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.087054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '0661c8ef-63c2-44b7-97e0-75589941047e', 'network_id': '87543dfa-9cef-40b2-b537-1f95fcf2b066', 'port_id': '0661c8ef-63c2-44b7-97e0-75589941047e', 'mac_address': 'fa:16:3e:20:14:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 679, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '409c7043-b3b6-42f7-90b5-f7db5d717e70', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:42:01.092845 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:42:01.108800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-3ea06e18-086d-4249-b4d1-a75243d2a0e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.110642 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-3ea06e18-086d-4249-b4d1-a75243d2a0e7 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.2513957
Jun 02 16:42:01.113003 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.138228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:42:01.138444 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.233149 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-047afd6a-d8df-494b-aa5c-6a5ecc008a7c service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.1097205
Jun 02 16:42:01.246134 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.250655 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.260546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-208c87ba-31a9-4d88-bbfb-994ca5ddd11c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:01.267783 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0661c8ef-63c2-44b7-97e0-75589941047e {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:42:01.289749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4256726-4e7f-4c02-a6d1-08eac0063951,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:01.299446 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0661c8ef-63c2-44b7-97e0-75589941047e,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:01.303307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:01.311081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.320893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-260eb5bb-ab06-4473-a284-b8cd4af35abc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.322477 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-260eb5bb-ab06-4473-a284-b8cd4af35abc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.0665560
Jun 02 16:42:01.331758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13d2423-cab9-484f-9def-1031e91c18d0 req-43d35da3-5144-495a-8982-a8f4963f3e50 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.333321 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e13d2423-cab9-484f-9def-1031e91c18d0 req-43d35da3-5144-495a-8982-a8f4963f3e50 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 944 time: 0.1692269
Jun 02 16:42:01.334977 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.336055 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e4256726-4e7f-4c02-a6d1-08eac0063951 HTTP/1.1" status: 204  len: 168 time: 0.3498583
Jun 02 16:42:01.345340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:01.426204 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e13d2423-cab9-484f-9def-1031e91c18d0 req-198df91b-581c-4ad8-83a3-f15f23de5c99 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0834267
Jun 02 16:42:01.440477 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-1e74ff10-d6df-4844-9b6d-220cbeb4a71b service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1018889
Jun 02 16:42:01.462065 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.489492 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:01.499723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:01.506792 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:01.509285 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93acdfac-2524-4aff-91c7-24e72111f47a" -d '{"events": [{"server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "name": "network-vif-plugged", "status": "completed", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:01.518577 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:01.524851 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.528189 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-8b91de57-1764-48e4-9ebc-ebd20c06973e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:01.569672 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d7bbcd1-5e2a-4d62-81e1-80387e77aee4 x-openstack-request-id: req-7d7bbcd1-5e2a-4d62-81e1-80387e77aee4 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:01.569870 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "name": "network-vif-plugged", "status": "completed", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:01.570274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-7d7bbcd1-5e2a-4d62-81e1-80387e77aee4 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:01.570781 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57', 'code': 200}
Jun 02 16:42:01.589096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd5b31e-e83b-4256-9896-eb7126d41314 req-fcd972e7-b7c2-4672-b565-5feb5a7d92eb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.590660 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fcd5b31e-e83b-4256-9896-eb7126d41314 req-fcd972e7-b7c2-4672-b565-5feb5a7d92eb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.2022915
Jun 02 16:42:01.623301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:01.642133 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:01.666637 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-a52485b9-d56d-4551-9590-f6225dfd4c72 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2173426
Jun 02 16:42:01.676806 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fcd5b31e-e83b-4256-9896-eb7126d41314 req-e66e23e5-cac9-44ce-a5b3-8a99ef76ec55 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0699928
Jun 02 16:42:01.844539 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c7ce36-faa0-4408-a25c-859237218316 req-41d9b58c-68ff-4ff2-b814-03248995f58e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.846218 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40c7ce36-faa0-4408-a25c-859237218316 req-41d9b58c-68ff-4ff2-b814-03248995f58e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.1323013
Jun 02 16:42:01.849551 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:01.877687 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['0661c8ef-63c2-44b7-97e0-75589941047e'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:42:01.895962 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-efae71f6-bcd3-42b5-96ee-5adb37004db1 req-c4ed8137-4676-43ee-bf69-fe2c1bf746f4 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2084019
Jun 02 16:42:01.956035 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40c7ce36-faa0-4408-a25c-859237218316 req-37a16819-1717-4729-8a93-7bc1429c8fb2 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1031396
Jun 02 16:42:01.975031 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516b86f9-bf64-4252-b561-a7fe7d8b5c55 req-ee19602a-a194-4bb9-b08e-35ffba4798ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:01.976906 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-516b86f9-bf64-4252-b561-a7fe7d8b5c55 req-ee19602a-a194-4bb9-b08e-35ffba4798ad service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 1098 time: 0.1223781
Jun 02 16:42:02.039929 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-516b86f9-bf64-4252-b561-a7fe7d8b5c55 req-0fb6b44f-4d96-485a-a8f6-b0b020d764b9 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400207
Jun 02 16:42:02.196061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ea2455-b3bc-4e6a-8a1a-a9891636e7c2 req-a0623678-782d-4b02-9548-771dd0680789 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:02.198011 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d4ea2455-b3bc-4e6a-8a1a-a9891636e7c2 req-a0623678-782d-4b02-9548-771dd0680789 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 945 time: 0.0918984
Jun 02 16:42:02.241721 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7617d94f-50c4-4292-9abc-fa34c6cedb41 req-061616a9-f0b2-4a84-b275-5ce8cd48b255 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:02.243406 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7617d94f-50c4-4292-9abc-fa34c6cedb41 req-061616a9-f0b2-4a84-b275-5ce8cd48b255 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0878420
Jun 02 16:42:02.251685 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d4ea2455-b3bc-4e6a-8a1a-a9891636e7c2 req-945ebb6e-fe77-4828-bc67-7e98d2a1ecce tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446899
Jun 02 16:42:02.302195 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7617d94f-50c4-4292-9abc-fa34c6cedb41 req-d4370b54-f589-4d77-b1dc-c53cc516fb3e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0523789
Jun 02 16:42:02.614449 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4d0453-c810-4da4-9f88-09c4caf2418c req-b9830f8c-04d6-4327-ad5a-ad914d8e7d49 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:02.615880 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ef4d0453-c810-4da4-9f88-09c4caf2418c req-b9830f8c-04d6-4327-ad5a-ad914d8e7d49 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 945 time: 0.0936124
Jun 02 16:42:02.662444 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ef4d0453-c810-4da4-9f88-09c4caf2418c req-9d2ce3d0-da54-4976-af1f-26c250a2646d tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396142
Jun 02 16:42:02.812042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:42:02.919119 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdfa1bc-3c86-4213-b982-0dfcc1e27c6f req-5a989643-8867-48ab-a092-10fd693994db tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:02.927061 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cfdfa1bc-3c86-4213-b982-0dfcc1e27c6f req-5a989643-8867-48ab-a092-10fd693994db tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1190541
Jun 02 16:42:02.932908 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-7d546a55-d1e7-4283-8944-fa5a8320168b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:02.935291 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-7d546a55-d1e7-4283-8944-fa5a8320168b tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.1445613
Jun 02 16:42:03.011627 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:03.028537 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:42:03.078081 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cfdfa1bc-3c86-4213-b982-0dfcc1e27c6f req-b29cb2d3-4b6d-4855-9bb0-c90a7e1724ae tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1493673
Jun 02 16:42:03.112520 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.129556 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:42:03.147685 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:03.152069 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.154106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0326f6e5-8013-483e-b217-a66c346398c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:03.182102 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Deleting port adb58373-96f1-4492-8257-4dcc98dd2072 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:42:03.182669 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.240071 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=6']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:03.245101 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:03.340915 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['cf7356d3-b193-4ccb-a580-fe9976ab37df'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:42:03.444079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2273b9-1a04-4274-ae03-78a1fe985634 req-ee51bab1-4e2d-440a-b7a9-2a6a3b4d3553 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:03.451500 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5c2273b9-1a04-4274-ae03-78a1fe985634 req-ee51bab1-4e2d-440a-b7a9-2a6a3b4d3553 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 945 time: 0.3384321
Jun 02 16:42:03.454700 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] For port adb58373-96f1-4492-8257-4dcc98dd2072, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=adb58373-96f1-4492-8257-4dcc98dd2072,segment=NetworkSegment(2b0ce5ce-fbb7-47ce-a4be-382c2e52a877),segment_id=2b0ce5ce-fbb7-47ce-a4be-382c2e52a877)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:03.455039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.465866 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5470a2a8-ac3d-4e28-814d-95ec968cb26a req-371cac09-370d-40b4-9f35-d386cd4d7bf2 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:03.467421 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5470a2a8-ac3d-4e28-814d-95ec968cb26a req-371cac09-370d-40b4-9f35-d386cd4d7bf2 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 945 time: 0.1021814
Jun 02 16:42:03.517016 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5470a2a8-ac3d-4e28-814d-95ec968cb26a req-2f5d3910-b202-4328-8196-051f37c50bdd tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437236
Jun 02 16:42:03.607698 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Calling delete_port for adb58373-96f1-4492-8257-4dcc98dd2072 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:42:03.638320 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5c2273b9-1a04-4274-ae03-78a1fe985634 req-5e66a203-1580-414c-8048-34fc6298e89a tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd0a0b0d-fc16-4932-8115-906cb70c4047&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1856587
Jun 02 16:42:03.729708 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8f5c05-dcde-4896-9a26-7d79b5fd71fd req-14e40378-0181-4555-bf42-103ab21b2344 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:03.737433 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5f8f5c05-dcde-4896-9a26-7d79b5fd71fd req-14e40378-0181-4555-bf42-103ab21b2344 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1040599
Jun 02 16:42:03.738534 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.779481 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5f8f5c05-dcde-4896-9a26-7d79b5fd71fd req-59a9a1b3-529b-4327-8178-b4b66ff65966 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411828
Jun 02 16:42:03.805539 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.812011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-caadabd1-9e7c-4b15-8dbd-777cf5bc179e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:03.825017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['adb58373-96f1-4492-8257-4dcc98dd2072'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:42:03.859974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Pushing event deleted for resources: {'Port': ['ID=adb58373-96f1-4492-8257-4dcc98dd2072,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:03.863839 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:03.942247 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] No DVR routers for this DVR port adb58373-96f1-4492-8257-4dcc98dd2072 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:42:03.944833 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:03.948074 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'name': 'network-vif-deleted', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:03.950690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b679916f-4a33-4c52-b9f8-52b1b1785948" -d '{"events": [{"server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "name": "network-vif-deleted", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:03.968321 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-02811c54-80a4-4d78-bf58-2ad4146c0f64 req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.20 "DELETE /v2.0/ports/adb58373-96f1-4492-8257-4dcc98dd2072 HTTP/1.1" status: 204  len: 173 time: 1.0254211
Jun 02 16:42:04.004171 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20010e52-63a3-4cc6-bc09-dc27f9a277e9 x-openstack-request-id: req-20010e52-63a3-4cc6-bc09-dc27f9a277e9 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:04.004595 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73be903c-f66e-4ef1-bfa8-626ab2082f73", "name": "network-vif-deleted", "tag": "adb58373-96f1-4492-8257-4dcc98dd2072", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:04.004748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-20010e52-63a3-4cc6-bc09-dc27f9a277e9 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:04.005203 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73be903c-f66e-4ef1-bfa8-626ab2082f73', 'name': 'network-vif-deleted', 'tag': 'adb58373-96f1-4492-8257-4dcc98dd2072', 'status': 'completed', 'code': 200}
Jun 02 16:42:04.009889 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b222eb37-f674-4250-9ece-22f78a0f8731 req-939eff6b-ed9b-49c6-9b19-ef784fe8ba26 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:04.011433 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b222eb37-f674-4250-9ece-22f78a0f8731 req-939eff6b-ed9b-49c6-9b19-ef784fe8ba26 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 945 time: 0.1194234
Jun 02 16:42:04.078507 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b222eb37-f674-4250-9ece-22f78a0f8731 req-94aece17-8a54-4a50-ba15-c1f94b7ab335 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0555995
Jun 02 16:42:04.331225 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b857fce7-dfad-4456-90b7-0dcde2e3d5fa req-bc63a1d5-58b3-4814-b6b2-bb75be6b0f03 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:04.338177 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b857fce7-dfad-4456-90b7-0dcde2e3d5fa req-bc63a1d5-58b3-4814-b6b2-bb75be6b0f03 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.1291964
Jun 02 16:42:04.384646 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b857fce7-dfad-4456-90b7-0dcde2e3d5fa req-07f66362-501a-4c45-a31a-c7aa9270948a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0452731
Jun 02 16:42:04.822909 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f86c65a-b6ed-4d2d-975f-d9ff972999d8 req-d0bfdc4d-4cfa-4d54-8c8e-4f67761418fa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:04.824657 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f86c65a-b6ed-4d2d-975f-d9ff972999d8 req-d0bfdc4d-4cfa-4d54-8c8e-4f67761418fa tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 945 time: 0.1855044
Jun 02 16:42:04.896906 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8f86c65a-b6ed-4d2d-975f-d9ff972999d8 req-605a8bb9-bc31-4409-beb7-af52ab8420d8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0586340
Jun 02 16:42:04.957000 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-dc7f2985-720a-4124-af68-40273fe6c171 req-4327c11e-cdae-4648-af87-d507a02acf20 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Synchronizing usage tracker for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:04.976120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-dc7f2985-720a-4124-af68-40273fe6c171 req-4327c11e-cdae-4648-af87-d507a02acf20 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Unset dirty status for tenant:a1836d0c3dbd473ca08d38562b52e19d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:04.977458 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dc7f2985-720a-4124-af68-40273fe6c171 req-4327c11e-cdae-4648-af87-d507a02acf20 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 210 time: 0.0884061
Jun 02 16:42:05.107599 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f96b9e6-5994-401b-8187-4b46388b7345 req-187fa53a-53a4-409e-812b-aa3f070141e7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:05.109176 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9f96b9e6-5994-401b-8187-4b46388b7345 req-187fa53a-53a4-409e-812b-aa3f070141e7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0948982
Jun 02 16:42:05.158633 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9f96b9e6-5994-401b-8187-4b46388b7345 req-52c98935-c9b3-4056-8a0f-93dfe1a3ba9f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436289
Jun 02 16:42:05.583100 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d71e68-4c9b-40f1-9bd0-53697c04ce18 req-35af1daf-164c-459d-95bb-fd564952e11e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:05.584596 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e8d71e68-4c9b-40f1-9bd0-53697c04ce18 req-35af1daf-164c-459d-95bb-fd564952e11e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.0802064
Jun 02 16:42:05.630264 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e8d71e68-4c9b-40f1-9bd0-53697c04ce18 req-cb974596-32fa-4a27-9c1c-73a755e3ff84 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397234
Jun 02 16:42:06.091672 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3897f7ea-e5e7-40b5-85b1-e8ce5a974179 req-f7fce560-945a-416f-8ef9-b72e3264d243 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:06.093186 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3897f7ea-e5e7-40b5-85b1-e8ce5a974179 req-f7fce560-945a-416f-8ef9-b72e3264d243 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 945 time: 0.0838249
Jun 02 16:42:06.146674 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3897f7ea-e5e7-40b5-85b1-e8ce5a974179 req-47d7a216-5367-40f7-97ad-0e70fdb54b76 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464187
Jun 02 16:42:06.326880 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d3e32ca3-29e7-4263-8392-84005af13f40 req-b1ac47ff-35b0-4ede-ae84-beb163a0ba7e tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 210 time: 0.0520747
Jun 02 16:42:06.509269 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd40e82c-8ab0-4ffc-8f6c-ea46d8298452 req-3bb14df5-5466-4536-a24e-a3d037e5d444 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:06.510767 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dd40e82c-8ab0-4ffc-8f6c-ea46d8298452 req-3bb14df5-5466-4536-a24e-a3d037e5d444 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0830965
Jun 02 16:42:06.555359 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dd40e82c-8ab0-4ffc-8f6c-ea46d8298452 req-80cf8c5e-9d63-4790-a942-98259d857ac6 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385737
Jun 02 16:42:06.775515 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:42:06.825722 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559730e7-c493-4207-8851-50f5a4c4e503 req-1f4ec34b-826d-4b20-8c4d-945270a958de tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:06.827246 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-559730e7-c493-4207-8851-50f5a4c4e503 req-1f4ec34b-826d-4b20-8c4d-945270a958de tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.0820637
Jun 02 16:42:06.846034 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port cf7356d3-b193-4ccb-a580-fe9976ab37df triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:42:06.846410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:06.882854 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-559730e7-c493-4207-8851-50f5a4c4e503 req-46a5e12d-8f00-46c1-8f52-dfcca1229e20 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0495751
Jun 02 16:42:06.964385 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:06.992194 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:06.994470 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c8ef216-bd96-4c74-ba09-70e410286fd6" -d '{"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:07.002118 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:07.007287 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:07.008222 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 0661c8ef-63c2-44b7-97e0-75589941047e up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:42:07.038011 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:07.070467 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4002fd83-d49a-44b7-847e-48f9be5d39bc x-openstack-request-id: req-4002fd83-d49a-44b7-847e-48f9be5d39bc {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:07.070744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:07.071009 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-4002fd83-d49a-44b7-847e-48f9be5d39bc {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:07.071402 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'code': 200}
Jun 02 16:42:07.131871 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=7']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:07.134990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:07.146198 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 0661c8ef-63c2-44b7-97e0-75589941047e completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:42:07.152631 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 0661c8ef-63c2-44b7-97e0-75589941047e triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:42:07.153021 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:07.276638 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:07.323124 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0661c8ef-63c2-44b7-97e0-75589941047e,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:07.330308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:07.332486 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:07.383599 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407a58bb-d62a-44e5-a104-f4047982847e req-e1710a03-a796-4a72-aaeb-952cbe3d59a2 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:07.389666 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-407a58bb-d62a-44e5-a104-f4047982847e req-e1710a03-a796-4a72-aaeb-952cbe3d59a2 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 945 time: 0.1279464
Jun 02 16:42:07.413134 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:07.416409 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:07.440969 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-407a58bb-d62a-44e5-a104-f4047982847e req-84222ae0-85c1-419d-a743-492cd7e0b82d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446401
Jun 02 16:42:07.676649 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e4f2f6ec-bde1-4821-a452-c3c7b6cbeb58 req-84cd7baa-544d-4695-85ac-89bc5a553323 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] 10.222.0.25 "GET /v2.0/ports?device_id=73be903c-f66e-4ef1-bfa8-626ab2082f73 HTTP/1.1" status: 200  len: 210 time: 0.0423691
Jun 02 16:42:07.860483 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0093c5d6-58b8-49ba-8976-563e8ef0f028 req-abd295a6-ebf5-4276-a306-7b9dd7168a46 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:07.862169 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0093c5d6-58b8-49ba-8976-563e8ef0f028 req-abd295a6-ebf5-4276-a306-7b9dd7168a46 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0903769
Jun 02 16:42:07.884836 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adb58373-96f1-4492-8257-4dcc98dd2072 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:42:07.925173 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: adb58373-96f1-4492-8257-4dcc98dd2072 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:42:07.925709 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device adb58373-96f1-4492-8257-4dcc98dd2072 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:42:07.936995 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0093c5d6-58b8-49ba-8976-563e8ef0f028 req-5111400c-bf1e-4e19-9d63-524c0e88a1fc tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0687387
Jun 02 16:42:08.139395 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca12642-5f4f-41b5-8c83-3a5ce51f8f1a req-f8aa5b79-dd55-4579-914b-1e340e70e26c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:08.141115 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ca12642-5f4f-41b5-8c83-3a5ce51f8f1a req-f8aa5b79-dd55-4579-914b-1e340e70e26c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.0863435
Jun 02 16:42:08.189296 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ca12642-5f4f-41b5-8c83-3a5ce51f8f1a req-aa803d41-24ea-4e03-b400-0a8c4c46c363 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422952
Jun 02 16:42:08.683786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c01ed1-5487-4434-98d2-06845fcaf7df req-0b11cada-2f55-4a94-ba89-2e9ffb0b188d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:08.696826 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a8c01ed1-5487-4434-98d2-06845fcaf7df req-0b11cada-2f55-4a94-ba89-2e9ffb0b188d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.1226382
Jun 02 16:42:08.764216 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a8c01ed1-5487-4434-98d2-06845fcaf7df req-4da9a438-9f5d-4af1-8270-1d8b8cc842b7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658538
Jun 02 16:42:09.073091 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:09.075847 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96e559ad-7e0a-49e9-9652-da127b2ccfca" -d '{"events": [{"server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "name": "network-vif-plugged", "status": "completed", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:09.282637 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7770915-031f-4a0f-b56b-803e0ed2a0fa x-openstack-request-id: req-b7770915-031f-4a0f-b56b-803e0ed2a0fa {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:09.282941 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "name": "network-vif-plugged", "status": "completed", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:09.283201 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b7770915-031f-4a0f-b56b-803e0ed2a0fa {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:09.283593 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e', 'code': 200}
Jun 02 16:42:09.329473 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d8c18c-f832-4bc8-9103-aa9fd05881c5 req-312d4436-f21e-474d-87e8-d43f6673d27f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:09.331148 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-11d8c18c-f832-4bc8-9103-aa9fd05881c5 req-312d4436-f21e-474d-87e8-d43f6673d27f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2085557
Jun 02 16:42:09.410912 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-11d8c18c-f832-4bc8-9103-aa9fd05881c5 req-0a024b6c-6969-49a8-9565-ae8cbf537fc4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0705009
Jun 02 16:42:09.567240 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d83964e-beac-4e17-882d-20cb441082fe req-f16a891a-5592-4dbe-8eaf-cf00f769b50b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:09.568906 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2d83964e-beac-4e17-882d-20cb441082fe req-f16a891a-5592-4dbe-8eaf-cf00f769b50b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1519141
Jun 02 16:42:09.647692 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2d83964e-beac-4e17-882d-20cb441082fe req-841bff91-ea7b-4bc6-90a1-1c35d7a004fe tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0721111
Jun 02 16:42:10.011545 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0977d95d-a58a-49d2-86a3-362c010684eb req-ddee05fe-84db-43bb-b865-7b40e081d1a8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:10.013318 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0977d95d-a58a-49d2-86a3-362c010684eb req-ddee05fe-84db-43bb-b865-7b40e081d1a8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.1105509
Jun 02 16:42:10.068723 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0977d95d-a58a-49d2-86a3-362c010684eb req-35379a3d-cb02-4ba8-91a2-b78cbca4ebf8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485783
Jun 02 16:42:10.634999 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1145bd03-ce77-4d50-9eca-ef52e07a1856 req-e17ab7ff-cd29-4b1e-be8f-cb6ea67e3c33 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:10.636889 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1145bd03-ce77-4d50-9eca-ef52e07a1856 req-e17ab7ff-cd29-4b1e-be8f-cb6ea67e3c33 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0931270
Jun 02 16:42:10.696689 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1145bd03-ce77-4d50-9eca-ef52e07a1856 req-6d09c557-2ee7-4b32-9b84-7a178a231397 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532904
Jun 02 16:42:10.925091 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7264d391-4990-47e1-95cf-a175e96d9562 req-8ebf168a-ce36-4c9e-95b4-9dd17a9a6ee7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:10.927324 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7264d391-4990-47e1-95cf-a175e96d9562 req-8ebf168a-ce36-4c9e-95b4-9dd17a9a6ee7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1010690
Jun 02 16:42:11.010347 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7264d391-4990-47e1-95cf-a175e96d9562 req-781634be-2cde-472e-9b5c-e51aa991fcc5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0679674
Jun 02 16:42:11.314673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fdacbc-b8ea-4ec4-a28f-62640dca8b80 req-8c1ccc17-aeca-489d-998c-83ae9d564d50 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:11.319391 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-17fdacbc-b8ea-4ec4-a28f-62640dca8b80 req-8c1ccc17-aeca-489d-998c-83ae9d564d50 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.1194205
Jun 02 16:42:11.373330 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-17fdacbc-b8ea-4ec4-a28f-62640dca8b80 req-007783ad-7efd-4451-815e-5c97a678acad tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455601
Jun 02 16:42:11.972180 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bacf2b72-34b2-46df-b8dd-1c8180b0d2cf req-b032e100-83fc-4f79-b450-728c4f11246a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:11.978548 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bacf2b72-34b2-46df-b8dd-1c8180b0d2cf req-b032e100-83fc-4f79-b450-728c4f11246a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1339736
Jun 02 16:42:12.026284 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bacf2b72-34b2-46df-b8dd-1c8180b0d2cf req-6890ef2a-20da-416f-b685-850f045d3baf tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443747
Jun 02 16:42:12.262236 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-036b4c25-a2e5-4bae-a075-3088a72f83b0 req-f136de03-0d54-4301-b1b5-403b57c9eb26 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:12.263831 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-036b4c25-a2e5-4bae-a075-3088a72f83b0 req-f136de03-0d54-4301-b1b5-403b57c9eb26 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1069303
Jun 02 16:42:12.322234 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-036b4c25-a2e5-4bae-a075-3088a72f83b0 req-70bd7e38-ec02-4616-bace-0ddb72597781 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0524750
Jun 02 16:42:12.587146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15785df-bcc8-4128-aa05-e6aceffbbb60 req-d0257925-ca23-45de-a911-583141d76443 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:12.588823 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d15785df-bcc8-4128-aa05-e6aceffbbb60 req-d0257925-ca23-45de-a911-583141d76443 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.0915234
Jun 02 16:42:12.643952 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d15785df-bcc8-4128-aa05-e6aceffbbb60 req-e3072f40-ba8c-4b48-99d8-71194f9f5529 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489993
Jun 02 16:42:13.256238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b5409d-eeef-45ea-9812-c1c1488e1233 req-707bae40-ed82-4e68-bd25-ceb25e875672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:13.257794 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56b5409d-eeef-45ea-9812-c1c1488e1233 req-707bae40-ed82-4e68-bd25-ceb25e875672 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 1099 time: 0.1704853
Jun 02 16:42:13.306827 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e88a87-b381-45c9-b7a1-04e587182118 req-4b90f1a2-d05c-4b8a-a848-a77140354f2d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:13.308551 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-34e88a87-b381-45c9-b7a1-04e587182118 req-4b90f1a2-d05c-4b8a-a848-a77140354f2d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1307127
Jun 02 16:42:13.348289 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-56b5409d-eeef-45ea-9812-c1c1488e1233 req-ccdaf9f5-c0b5-46b7-8bff-271800abb8dd service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0804887
Jun 02 16:42:13.383267 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-34e88a87-b381-45c9-b7a1-04e587182118 req-dd85afee-48a3-4925-b6ef-293618629d46 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654163
Jun 02 16:42:13.546893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53a9935-9bfa-4749-820f-fa445d4430a9 req-54ac28d7-d016-4d63-b7cb-818d98fc7acd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:13.548439 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f53a9935-9bfa-4749-820f-fa445d4430a9 req-54ac28d7-d016-4d63-b7cb-818d98fc7acd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1008012
Jun 02 16:42:13.611407 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f53a9935-9bfa-4749-820f-fa445d4430a9 req-c5632cc7-8aaa-4791-9d88-04d910db1d6d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0565031
Jun 02 16:42:13.981039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-127b4c49-1e7c-46ea-b7a0-9fc69f0302cb req-6b00f1f0-1468-4fef-826d-8e039155d5c1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:13.993873 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-127b4c49-1e7c-46ea-b7a0-9fc69f0302cb req-6b00f1f0-1468-4fef-826d-8e039155d5c1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.2222891
Jun 02 16:42:14.054137 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-127b4c49-1e7c-46ea-b7a0-9fc69f0302cb req-536ee590-3f87-4674-af33-6508c249beae tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0592766
Jun 02 16:42:14.616078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b55970-5704-48ac-b72a-202532f74e22 req-c2594145-f2d6-479d-9096-59a71a306c5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:14.617634 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-85b55970-5704-48ac-b72a-202532f74e22 req-c2594145-f2d6-479d-9096-59a71a306c5a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1207211
Jun 02 16:42:14.701536 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-85b55970-5704-48ac-b72a-202532f74e22 req-957799af-6a7c-42e1-bae0-2457796d97ee tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0710618
Jun 02 16:42:14.825643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f7ac55-1f2a-4f0c-a236-89d54973207d req-e8928fdf-ddc3-4c36-bfcc-b3ff183cbb12 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:14.832452 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a5f7ac55-1f2a-4f0c-a236-89d54973207d req-e8928fdf-ddc3-4c36-bfcc-b3ff183cbb12 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.0955894
Jun 02 16:42:14.908163 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a5f7ac55-1f2a-4f0c-a236-89d54973207d req-b7f8c751-d092-4b46-9939-68f616cf0513 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0747571
Jun 02 16:42:15.281525 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adef420d-7449-4e13-b7c1-5e67c6aa27d1 req-1971c424-f120-40e3-8e89-53dbcdd3b643 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:15.290924 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adef420d-7449-4e13-b7c1-5e67c6aa27d1 req-1971c424-f120-40e3-8e89-53dbcdd3b643 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.1061654
Jun 02 16:42:15.353473 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adef420d-7449-4e13-b7c1-5e67c6aa27d1 req-b89a250b-4fbb-44c9-8f2b-edb4045744a0 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610471
Jun 02 16:42:15.958120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cfb74a6-fdfe-4838-bd4f-7c4ff15d7083 req-7d871ea7-098d-4911-9fc1-92ea1ff87600 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:15.959736 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5cfb74a6-fdfe-4838-bd4f-7c4ff15d7083 req-7d871ea7-098d-4911-9fc1-92ea1ff87600 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1192486
Jun 02 16:42:16.014153 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5cfb74a6-fdfe-4838-bd4f-7c4ff15d7083 req-b8d4d34a-95a9-4ce2-a507-8dd943ef0c23 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479078
Jun 02 16:42:16.230859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aacf5da-a39f-48da-af58-b56152b5f931 req-f0ba537a-aa3c-4127-8cc8-fc224d739e46 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:16.232705 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7aacf5da-a39f-48da-af58-b56152b5f931 req-f0ba537a-aa3c-4127-8cc8-fc224d739e46 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1019819
Jun 02 16:42:16.283317 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7aacf5da-a39f-48da-af58-b56152b5f931 req-ca5019cc-a98d-494d-b4db-8b7d8b8462b3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435605
Jun 02 16:42:17.246130 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c530ab-1aab-476c-afb7-a4a30d99e59f req-621dfc87-70b3-4b1c-9dc9-26b790d34eed tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:17.248790 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e4c530ab-1aab-476c-afb7-a4a30d99e59f req-621dfc87-70b3-4b1c-9dc9-26b790d34eed tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1044102
Jun 02 16:42:17.296514 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e4c530ab-1aab-476c-afb7-a4a30d99e59f req-6c6dd933-ceac-489b-a150-a4587b0b3c71 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411010
Jun 02 16:42:17.518105 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0efdca-1ca1-45a2-a08c-e76048abb3a1 req-9f2ce9b2-2129-4d87-a3bc-d33040916154 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:17.519950 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9c0efdca-1ca1-45a2-a08c-e76048abb3a1 req-9f2ce9b2-2129-4d87-a3bc-d33040916154 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1129150
Jun 02 16:42:17.605000 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9c0efdca-1ca1-45a2-a08c-e76048abb3a1 req-5c001694-14ee-4676-989c-38174fb40973 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0786061
Jun 02 16:42:18.501883 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2c3bca-8ae7-46f3-8766-c94de6348c9d req-46e49c65-416b-4ab6-a7e4-727385edfcda tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:18.503298 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6f2c3bca-8ae7-46f3-8766-c94de6348c9d req-46e49c65-416b-4ab6-a7e4-727385edfcda tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0836256
Jun 02 16:42:18.552633 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6f2c3bca-8ae7-46f3-8766-c94de6348c9d req-76bd6124-bb8f-4592-bb92-54da5ab504ca tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431960
Jun 02 16:42:18.836868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39fd2ce3-38a2-4ba3-bd0a-ec72dfcb1377 req-36231fe8-4b3e-4d6d-b1dd-f195e2dfc58b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:18.838547 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-39fd2ce3-38a2-4ba3-bd0a-ec72dfcb1377 req-36231fe8-4b3e-4d6d-b1dd-f195e2dfc58b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1064100
Jun 02 16:42:18.892072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-39fd2ce3-38a2-4ba3-bd0a-ec72dfcb1377 req-7b4e9bcc-fb87-4c72-a3b0-bb0e0183db6b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0457151
Jun 02 16:42:23.034738 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e984823a-62ff-485f-961a-893d24f86f9e req-85853a4e-27aa-4bab-bcf2-5157373637aa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.036507 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e984823a-62ff-485f-961a-893d24f86f9e req-85853a4e-27aa-4bab-bcf2-5157373637aa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1224284
Jun 02 16:42:23.126853 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e984823a-62ff-485f-961a-893d24f86f9e req-598bad7d-ed3a-4437-b1af-65af8a1771e5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0836978
Jun 02 16:42:23.257995 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab25c66-df55-44bf-9893-9887466b45b9 req-554a9ad3-e4e5-40cf-811f-a8f044b6f23c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.259481 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ab25c66-df55-44bf-9893-9887466b45b9 req-554a9ad3-e4e5-40cf-811f-a8f044b6f23c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 945 time: 0.1732748
Jun 02 16:42:23.281827 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-2c258756-7986-4ccf-aa89-dd35b8fb3540 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.283370 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-2c258756-7986-4ccf-aa89-dd35b8fb3540 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1098 time: 0.1352563
Jun 02 16:42:23.352739 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ab25c66-df55-44bf-9893-9887466b45b9 req-94c00dfd-848d-47f6-ba21-7c689cea0126 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0869312
Jun 02 16:42:23.439881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-fbe942cf-3819-4bd1-805d-b45a9bad7c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.441325 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-fbe942cf-3819-4bd1-805d-b45a9bad7c18 service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.1496806
Jun 02 16:42:23.555225 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-565f073b-b13d-4e72-b496-740d662340d1 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 200  len: 1001 time: 0.0973651
Jun 02 16:42:23.629067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-052e7bf5-fa2e-4e35-9ba3-696e272cb5cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.630535 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-052e7bf5-fa2e-4e35-9ba3-696e272cb5cb service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0657589
Jun 02 16:42:23.716813 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-0ffa0bc2-41d8-4da1-af09-b4bf18ea6e12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:23.718760 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-0ffa0bc2-41d8-4da1-af09-b4bf18ea6e12 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0773385
Jun 02 16:42:23.861823 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-46515fea-08ab-4b3e-b37c-e5d17b3ee02f service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1344507
Jun 02 16:42:23.987340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:42:24.012792 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e98214cf-ca89-4e73-9ae1-9c5b93bd1164 req-e9aee0b3-708c-45a8-ba54-8f53350fddbc service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1400955
Jun 02 16:42:24.117032 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:24.246708 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:24.249387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea2e2364-1f1b-41bc-831a-b8e77a2a94e7" -d '{"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-unplugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:24.254900 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:24.262169 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:24.265859 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:24.376256 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=8']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:24.386412 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:24.393523 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afabc7b9-891a-4b1c-8a8d-e6a365b2b0ad x-openstack-request-id: req-afabc7b9-891a-4b1c-8a8d-e6a365b2b0ad {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:24.396135 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-unplugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:24.397383 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-afabc7b9-891a-4b1c-8a8d-e6a365b2b0ad {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:24.399656 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'code': 200}
Jun 02 16:42:24.501324 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ba45846-5e1d-4b51-b4d8-0e86440898b8 req-b2575917-9951-4812-9f46-807404547300 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:24.511144 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ba45846-5e1d-4b51-b4d8-0e86440898b8 req-b2575917-9951-4812-9f46-807404547300 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1862841
Jun 02 16:42:24.694745 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1ba45846-5e1d-4b51-b4d8-0e86440898b8 req-02c2c94d-f4ed-4260-8cf8-7abac039b665 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1820834
Jun 02 16:42:24.706124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef44842f-aff8-40d8-9295-b3e73cadd610 req-8b230dc1-612c-4fb2-8e04-139d5bfda143 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:24.708094 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ef44842f-aff8-40d8-9295-b3e73cadd610 req-8b230dc1-612c-4fb2-8e04-139d5bfda143 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1942401
Jun 02 16:42:24.765048 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ef44842f-aff8-40d8-9295-b3e73cadd610 req-8d26c576-8700-4e03-a3a4-2b06bf6ecb27 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0443766
Jun 02 16:42:25.823004 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9f0698e4-9bf4-4731-addb-ca8b67c79e2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:25.991576 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b735f903-5ada-4000-9680-2642a0e7b76c req-6e1a316a-7007-4470-a3bd-22ddb5ba4140 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:25.993217 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b735f903-5ada-4000-9680-2642a0e7b76c req-6e1a316a-7007-4470-a3bd-22ddb5ba4140 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1203425
Jun 02 16:42:26.041844 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29195a02-2574-4058-a829-00ae74986601 req-ab417ed3-4cfb-4488-9903-7064cf85ed82 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:26.043482 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-29195a02-2574-4058-a829-00ae74986601 req-ab417ed3-4cfb-4488-9903-7064cf85ed82 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1252522
Jun 02 16:42:26.051633 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b735f903-5ada-4000-9680-2642a0e7b76c req-08863c7d-336c-4538-b292-6da3ade21760 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466764
Jun 02 16:42:26.121048 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-29195a02-2574-4058-a829-00ae74986601 req-9281362d-449a-43c6-aaab-fcbc9c430a20 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0714238
Jun 02 16:42:27.376801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe969dd2-c20f-487d-b571-f4414a4c3580 req-0b93152f-ad20-46e0-b388-9562a4c93ac3 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:27.394287 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe969dd2-c20f-487d-b571-f4414a4c3580 req-0b93152f-ad20-46e0-b388-9562a4c93ac3 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1812665
Jun 02 16:42:27.445086 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe969dd2-c20f-487d-b571-f4414a4c3580 req-28d9a3c1-67bf-4718-a2d7-cf3a01a56249 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466771
Jun 02 16:42:27.455610 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87da8f7-e38f-4876-916d-b51320b95fd5 req-338378a5-e8c9-4ca3-94bc-98021631a9a9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:27.458120 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a87da8f7-e38f-4876-916d-b51320b95fd5 req-338378a5-e8c9-4ca3-94bc-98021631a9a9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1208489
Jun 02 16:42:27.580509 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a87da8f7-e38f-4876-916d-b51320b95fd5 req-62bd8cf8-f8d8-4e87-9040-50aab86c22e8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1090565
Jun 02 16:42:28.524366 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-326862f1-a475-41cf-aecc-461b466d9af5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:28.750334 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52450) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:28.768448 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:28.804418 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4c3fff-99bb-428f-bcc0-669e642ead30 req-f654c3a6-a547-4b6d-8063-e688f02b7862 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:28.806264 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ff4c3fff-99bb-428f-bcc0-669e642ead30 req-f654c3a6-a547-4b6d-8063-e688f02b7862 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1332691
Jun 02 16:42:28.922276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ff4c3fff-99bb-428f-bcc0-669e642ead30 req-ac53217a-0157-498c-9a4c-4530c52ee55b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1075633
Jun 02 16:42:29.140951 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:29.186219 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:42:29.199462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Usage tracker for resource:security_group_rule and tenant:1ba1f3c272e24341a7be56e84a8c5364 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:42:29.210006 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:42:29.315565 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:42:29.414821 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e39a472-90e7-4d10-b6bf-f01eafc38e07 req-c747657d-65d1-4fa7-9a4a-36a458c7c10b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:29.416850 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e39a472-90e7-4d10-b6bf-f01eafc38e07 req-c747657d-65d1-4fa7-9a4a-36a458c7c10b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1997156
Jun 02 16:42:29.531523 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-febb3332-7b93-489a-9f97-0f973b8b7b34 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:29.567956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-febb3332-7b93-489a-9f97-0f973b8b7b34 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:29.578625 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-febb3332-7b93-489a-9f97-0f973b8b7b34 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1074292760&fields=id&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 267 time: 0.1113019
Jun 02 16:42:29.610407 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:29.640125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e39a472-90e7-4d10-b6bf-f01eafc38e07 req-a5d789ef-9ebb-411f-91af-986796a45992 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2064729
Jun 02 16:42:29.649924 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:29.744405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-24e31a25-770a-40af-96c7-7e7570aefb81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:29.783014 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1ba1f3c272e24341a7be56e84a8c5364&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0306959
Jun 02 16:42:29.807461 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52476) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:29.872406 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9447277-86c3-4688-9fef-f932794bf504,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:29.891109 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:29.935802 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:29.985160 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:30.014499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:42:30.015377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-b03e9788-90a0-4677-9958-d0dcb22d587d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:30.017919 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-b03e9788-90a0-4677-9958-d0dcb22d587d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.4380689
Jun 02 16:42:30.057977 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-cdb10aec-f71e-494e-bb25-a070f78c7b8b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/quotas/2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 375 time: 0.0322535
Jun 02 16:42:30.073238 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:30.089888 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:30.131485 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9447277-86c3-4688-9fef-f932794bf504,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:30.133587 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:30.137852 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f9447277-86c3-4688-9fef-f932794bf504 HTTP/1.1" status: 204  len: 168 time: 0.3286109
Jun 02 16:42:30.140079 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:30.289841 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:30.306183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ab49d3-1a34-4b14-ae29-9411dbc9736d req-b043aa2b-ce5f-4aef-9ba0-f4c13f8d469c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:30.319324 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c3ab49d3-1a34-4b14-ae29-9411dbc9736d req-b043aa2b-ce5f-4aef-9ba0-f4c13f8d469c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1892593
Jun 02 16:42:30.351715 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-aeeb79d3-6930-4ca7-8bc8-4addb2946ef2 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2922723
Jun 02 16:42:30.481320 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c3ab49d3-1a34-4b14-ae29-9411dbc9736d req-1b8d3f23-744e-4541-8b30-491451d815c0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1595063
Jun 02 16:42:30.509770 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-bc7d0b48-9565-48da-9ffe-321b2a6df365 service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1570027
Jun 02 16:42:30.836618 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-8abda3d2-ea6b-4e24-8ae4-b75b7bbe88da service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3251526
Jun 02 16:42:31.168326 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e796c091-d43f-4ec1-8d9c-c811d9d0eae9 req-d88d1891-4d08-420c-b87e-6b9e67bc8316 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:31.174598 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e796c091-d43f-4ec1-8d9c-c811d9d0eae9 req-d88d1891-4d08-420c-b87e-6b9e67bc8316 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1530151
Jun 02 16:42:31.279041 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e796c091-d43f-4ec1-8d9c-c811d9d0eae9 req-301cbcd2-10d0-471f-a27d-312c2ab91677 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0968425
Jun 02 16:42:31.763614 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-09d31c00-abed-4a26-a67e-4e0b20563d1b req-f33dd15f-226f-4d71-b235-d437633c2f17 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:31.797275 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-09d31c00-abed-4a26-a67e-4e0b20563d1b req-f33dd15f-226f-4d71-b235-d437633c2f17 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:31.809924 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-09d31c00-abed-4a26-a67e-4e0b20563d1b req-f33dd15f-226f-4d71-b235-d437633c2f17 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 210 time: 0.2782114
Jun 02 16:42:31.861727 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:32.045646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65937e6c-7196-4feb-a6b1-dea2f6c7bb10 req-f8e0b11a-209d-4e7b-b7a6-69af69f8cb8b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:32.053910 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-65937e6c-7196-4feb-a6b1-dea2f6c7bb10 req-f8e0b11a-209d-4e7b-b7a6-69af69f8cb8b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.3833659
Jun 02 16:42:32.128074 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-65937e6c-7196-4feb-a6b1-dea2f6c7bb10 req-93a4e54c-d96e-44f2-a248-46956761e4c0 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0709651
Jun 02 16:42:32.721870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce2e6f0a-dde5-4271-9129-4a114f21982e req-5cf0fac2-6f67-4ee0-983e-e71d7cd26212 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:32.726089 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce2e6f0a-dde5-4271-9129-4a114f21982e req-5cf0fac2-6f67-4ee0-983e-e71d7cd26212 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1749873
Jun 02 16:42:32.834544 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce2e6f0a-dde5-4271-9129-4a114f21982e req-80e14d54-f093-42ed-b5cb-233f465994d8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1031475
Jun 02 16:42:32.866037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52558) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:33.140072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-2c224165-ee56-46cf-ac47-6ffd4fcf11c5 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.2705832
Jun 02 16:42:33.200702 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d3d73333-67ad-4451-86ba-83f57c320978 req-1899b441-d537-4952-91ba-7abf05713323 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 210 time: 0.1200104
Jun 02 16:42:33.504529 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78a27d0-4c3d-492e-86ac-a85f61526413 req-72d3a48d-18ae-4ad7-b563-d963158e892a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:33.507543 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c78a27d0-4c3d-492e-86ac-a85f61526413 req-72d3a48d-18ae-4ad7-b563-d963158e892a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1915581
Jun 02 16:42:33.591380 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c78a27d0-4c3d-492e-86ac-a85f61526413 req-59dbefab-17be-453c-aaf2-2d9f7474bbc1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0765750
Jun 02 16:42:33.741623 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:33.840492 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-ff06fb3a-aa45-4125-b280-edafa4cea7cf tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:33.842658 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-ff06fb3a-aa45-4125-b280-edafa4cea7cf tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.2469192
Jun 02 16:42:33.929290 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-401bb4a7-afa5-4a73-909b-0110c2f14d30 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 380 time: 0.0529664
Jun 02 16:42:33.951715 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'port': {'device_id': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'admin_state_up': True, 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'security_groups': ['63174eef-3e33-438d-a435-e3f28b518bec']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:42:34.242109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:42:34.253305 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:42:34.269888 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Made reservation on behalf of 2be2419a57e644b38a5c0ca942660a19 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:42:34.275248 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:34.317162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0618ae3-de4d-43d0-945e-739c2969ccc1 req-8b46a70c-d9ab-4c0a-a92f-327cb0e7c131 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:34.318772 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e0618ae3-de4d-43d0-945e-739c2969ccc1 req-8b46a70c-d9ab-4c0a-a92f-327cb0e7c131 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1989145
Jun 02 16:42:34.457995 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e0618ae3-de4d-43d0-945e-739c2969ccc1 req-b29eb52b-837a-4302-909f-e00918f6be63 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0956354
Jun 02 16:42:34.562544 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4bc5793f-d483-4e0d-a651-4de702d0548a req-526e370f-6844-48ae-8056-0391b2103cc6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 210 time: 0.0694838
Jun 02 16:42:34.599948 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.20.0.5 (00fea91a-5ad9-4ee8-ae53-59f9858b59ca/ca8cd98d-c3e8-45ac-8780-59a7fe077750/14762d04-cafa-47ea-9929-61cd3a540431) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:42:34.650552 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751156f5-5e09-46ee-8c2f-42516f3bb815 req-0b0ce74f-c223-4553-8b21-173aec3b3f9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:34.652130 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-751156f5-5e09-46ee-8c2f-42516f3bb815 req-0b0ce74f-c223-4553-8b21-173aec3b3f9d service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.2345054
Jun 02 16:42:34.741066 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-751156f5-5e09-46ee-8c2f-42516f3bb815 req-233a4a64-400b-4be5-a737-f18a052125b5 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0739069
Jun 02 16:42:34.927412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86439a48-9203-41a8-90e9-c8076b4f8fa1 req-c8cc670f-b99c-4aa6-ac6b-ec23ffa6eb6b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:34.929189 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-86439a48-9203-41a8-90e9-c8076b4f8fa1 req-c8cc670f-b99c-4aa6-ac6b-ec23ffa6eb6b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1328995
Jun 02 16:42:34.994056 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-86439a48-9203-41a8-90e9-c8076b4f8fa1 req-3e9374e0-a70b-42fd-a201-364ff483633e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585496
Jun 02 16:42:35.043341 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:35.063483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Transition to ACTIVE for port object 14762d04-cafa-47ea-9929-61cd3a540431 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:42:35.088629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:35.095710 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:35.203300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:35.211583 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:35.218514 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:42:35.219789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:42:35.224109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:42:35.351166 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:35.351901 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:35.409858 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4622605
Jun 02 16:42:35.434567 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Request body: {'port': {'device_id': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:42:35.563721 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-285b7514-1e5f-4e5c-ade5-9d6f85b390a7 None None] Provisioning for port 14762d04-cafa-47ea-9929-61cd3a540431 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:42:35.577068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-285b7514-1e5f-4e5c-ade5-9d6f85b390a7 None None] Provisioning complete for port 14762d04-cafa-47ea-9929-61cd3a540431 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:42:35.584755 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-285b7514-1e5f-4e5c-ade5-9d6f85b390a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:35.704341 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-285b7514-1e5f-4e5c-ade5-9d6f85b390a7 None None] Port 14762d04-cafa-47ea-9929-61cd3a540431 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:42:35.723762 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:35.855418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298a88b3-fb1d-4615-bab8-2150bb7b805b req-1903f7bc-89b3-4168-bebf-7dbd4c4bc12f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:35.866430 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-298a88b3-fb1d-4615-bab8-2150bb7b805b req-1903f7bc-89b3-4168-bebf-7dbd4c4bc12f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 931 time: 0.1420853
Jun 02 16:42:35.921693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-298a88b3-fb1d-4615-bab8-2150bb7b805b req-e53869f3-70c1-48ba-9bd6-e8949ac6d259 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:35.937363 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-298a88b3-fb1d-4615-bab8-2150bb7b805b req-e53869f3-70c1-48ba-9bd6-e8949ac6d259 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:35.948843 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-298a88b3-fb1d-4615-bab8-2150bb7b805b req-e53869f3-70c1-48ba-9bd6-e8949ac6d259 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0809188
Jun 02 16:42:36.078678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35187071-2351-489d-8a11-8906cef5b709 req-a3e90405-d723-4715-877a-2f0618dbbd3d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:36.086617 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35187071-2351-489d-8a11-8906cef5b709 req-a3e90405-d723-4715-877a-2f0618dbbd3d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.3648629
Jun 02 16:42:36.182669 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35187071-2351-489d-8a11-8906cef5b709 req-933ca9f6-bc11-4ae4-84dc-c429711b3d7e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0950761
Jun 02 16:42:36.478326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 14762d04-cafa-47ea-9929-61cd3a540431 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:42:36.488422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:36.528580 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Transition to ACTIVE for port object 14762d04-cafa-47ea-9929-61cd3a540431 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:42:36.595866 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:42:36.602362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:36.622182 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:36.872247 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Pushing event updated for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:36.881342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:36.966952 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07203404-d94f-41ce-bb96-8472e4e411ef req-240a589c-a168-46dc-9c8c-0a796065f9e4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:36.974620 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07203404-d94f-41ce-bb96-8472e4e411ef req-240a589c-a168-46dc-9c8c-0a796065f9e4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.4429896
Jun 02 16:42:36.980388 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b8dfe3-b8d0-404a-b1cf-e3fc09ebae76 req-0572caab-6f80-4160-b232-9ef43c51b431 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:36.992599 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-24b8dfe3-b8d0-404a-b1cf-e3fc09ebae76 req-0572caab-6f80-4160-b232-9ef43c51b431 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.1753509
Jun 02 16:42:37.099827 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-24b8dfe3-b8d0-404a-b1cf-e3fc09ebae76 req-a14f3456-ded6-43f0-a59c-c54039729085 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0982811
Jun 02 16:42:37.161136 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Attempting to bind port 14762d04-cafa-47ea-9929-61cd3a540431 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:42:37.161713 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Attempting to bind port 14762d04-cafa-47ea-9929-61cd3a540431 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:42:37.162213 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Attempting to bind port 14762d04-cafa-47ea-9929-61cd3a540431 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:42:37.171493 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-07203404-d94f-41ce-bb96-8472e4e411ef req-9378cef6-db06-468a-93e0-59b0374777e7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1846013
Jun 02 16:42:37.175876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Port 14762d04-cafa-47ea-9929-61cd3a540431 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:42:37.176205 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Attempting to bind port 14762d04-cafa-47ea-9929-61cd3a540431 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:42:37.198235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 42, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:42:37.198235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:42:37.198235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Bound using segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:42:37.198235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Bound port: 14762d04-cafa-47ea-9929-61cd3a540431, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:42:37.198235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:37.335769 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:42:37.343897 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=14762d04-cafa-47ea-9929-61cd3a540431,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:42:37.354934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:37.372842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69fc1548-2695-4af1-b2ca-b8f234be4e37 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:37.432604 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a814697-01de-40e1-b3f0-be729f5d1422 req-06d16da1-126f-480c-bf4e-35e96eb87d5d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:37.452090 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3a814697-01de-40e1-b3f0-be729f5d1422 req-06d16da1-126f-480c-bf4e-35e96eb87d5d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.2183104
Jun 02 16:42:37.505512 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:37.506181 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:37.512097 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] 10.222.0.20 "PUT /v2.0/ports/14762d04-cafa-47ea-9929-61cd3a540431 HTTP/1.1" status: 200  len: 1093 time: 2.0827169
Jun 02 16:42:37.514287 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:37.516773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310" -d '{"events": [{"name": "network-changed", "server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "tag": "14762d04-cafa-47ea-9929-61cd3a540431"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:37.554385 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3a814697-01de-40e1-b3f0-be729f5d1422 req-8100f841-d496-48a9-b3e1-a701c39cedc9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1011496
Jun 02 16:42:37.601006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Pushing event updated for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:37.606623 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:37.901453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-752e5cff-14e9-45ae-aa1c-ddb75a1217f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:37.903787 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-752e5cff-14e9-45ae-aa1c-ddb75a1217f1 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 1096 time: 0.2644196
Jun 02 16:42:37.930461 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-b3f23f17-c955-4393-99fa-a29955b6b014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:37.932743 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-b3f23f17-c955-4393-99fa-a29955b6b014 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 1096 time: 0.2114298
Jun 02 16:42:38.156228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-89822824-5e09-45cc-bdc7-51923de6f915 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.159242 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-89822824-5e09-45cc-bdc7-51923de6f915 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1096 time: 0.1944828
Jun 02 16:42:38.181317 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dd7bbd-33c0-43b7-b81c-03b20be4478e req-a7e81c97-514b-44a1-91ec-0734401b619f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.183064 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c8dd7bbd-33c0-43b7-b81c-03b20be4478e req-a7e81c97-514b-44a1-91ec-0734401b619f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.4357562
Jun 02 16:42:38.187106 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bde9c1e-889e-40a5-b170-2f6436213372 x-openstack-request-id: req-3bde9c1e-889e-40a5-b170-2f6436213372 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:38.187412 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "tag": "14762d04-cafa-47ea-9929-61cd3a540431", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:38.187683 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-3bde9c1e-889e-40a5-b170-2f6436213372 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:38.188098 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431', 'status': 'completed', 'code': 200}
Jun 02 16:42:38.189461 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-3e328ae1-ec4e-47ea-a5bf-69690603e15d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=14762d04-cafa-47ea-9929-61cd3a540431 HTTP/1.1" status: 200  len: 217 time: 0.2734678
Jun 02 16:42:38.427191 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c8dd7bbd-33c0-43b7-b81c-03b20be4478e req-e174f190-cabc-4a09-b5a8-94f361e32165 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2305591
Jun 02 16:42:38.496564 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-9a19deb7-9b7c-4adf-8f9f-b62c80a1ab9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.498642 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-9a19deb7-9b7c-4adf-8f9f-b62c80a1ab9d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.2694440
Jun 02 16:42:38.504746 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-e467954f-840e-40a3-a34c-7c90c4eb492d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.506607 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-e467954f-840e-40a3-a34c-7c90c4eb492d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 1098 time: 0.2149265
Jun 02 16:42:38.529451 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9e5011-cc25-48a9-b679-57413025c8b5 req-0a46591d-99f2-4502-88cc-8927d0d7bf51 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.537267 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7a9e5011-cc25-48a9-b679-57413025c8b5 req-0a46591d-99f2-4502-88cc-8927d0d7bf51 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2264264
Jun 02 16:42:38.587374 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-27d2f942-4617-453e-8362-d15ffa5641bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.589183 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-27d2f942-4617-453e-8362-d15ffa5641bc service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.4090326
Jun 02 16:42:38.703653 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7a9e5011-cc25-48a9-b679-57413025c8b5 req-44ff3b56-8a3b-4a75-bc81-0f32182b861c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1652350
Jun 02 16:42:38.745641 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-04c88dc3-10eb-4083-8762-992fe0151391 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 200  len: 999 time: 0.1425393
Jun 02 16:42:38.827730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-319236fb-a703-4e90-968e-630dab9fb4a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.829298 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-319236fb-a703-4e90-968e-630dab9fb4a1 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3172445
Jun 02 16:42:38.853154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-d75e9577-1e12-4af3-ae89-21d48680a6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.854938 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-d75e9577-1e12-4af3-ae89-21d48680a6d1 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.1025743
Jun 02 16:42:38.988809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-88d3edd1-40e9-455d-99db-1ce850c8ae54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:38.992232 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-88d3edd1-40e9-455d-99db-1ce850c8ae54 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.4191415
Jun 02 16:42:39.001443 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-413d927e-d5eb-4fe3-8636-ce73eac0d848 req-b55214b1-c313-4b65-8aca-12976e5f2109 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.013994 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-413d927e-d5eb-4fe3-8636-ce73eac0d848 req-b55214b1-c313-4b65-8aca-12976e5f2109 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.4053745
Jun 02 16:42:39.071605 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-0cb1e9d5-c167-4e24-a2bd-1e434ebb5b91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.076189 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-0cb1e9d5-c167-4e24-a2bd-1e434ebb5b91 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2049305
Jun 02 16:42:39.119539 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-efef4613-fb88-45f6-983d-f9c833d37738 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 200  len: 217 time: 0.1038580
Jun 02 16:42:39.121637 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-0f2536fc-e891-4e05-8e1e-5682c943a09e service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2830479
Jun 02 16:42:39.202669 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-413d927e-d5eb-4fe3-8636-ce73eac0d848 req-5d6438bd-1951-49d7-b39f-622d0dad331d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0799360
Jun 02 16:42:39.283125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-16df2286-1c0f-4f17-b7f3-668bd2e9a157 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2007694
Jun 02 16:42:39.370428 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-b76a77f4-c903-492e-9d66-3be9cb79d56d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.372118 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-b76a77f4-c903-492e-9d66-3be9cb79d56d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.1907749
Jun 02 16:42:39.476385 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-767a93a7-538b-4139-83cf-f3f057ff4e82 req-f87537f3-656a-4e16-84e9-ac1f361f1adb service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1481171
Jun 02 16:42:39.484046 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-e72c72aa-4aa2-4205-8c89-72babb3d75d4 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0941331
Jun 02 16:42:39.557955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-8227cc4c-0d84-4812-8b71-e1bb88230c5d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.559931 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-8227cc4c-0d84-4812-8b71-e1bb88230c5d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 946 time: 0.2758820
Jun 02 16:42:39.653937 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f352f4f4-70d0-48db-8bae-31d686e1b898 req-6e3116c9-7d79-4dff-b55d-eccff2e10831 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4711618
Jun 02 16:42:39.852072 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Deleting port 0661c8ef-63c2-44b7-97e0-75589941047e {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:42:39.852422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:39.924624 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-786fbe1d-d22d-414b-ad31-49c9b6055c9d service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4316907
Jun 02 16:42:39.934542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006d0d43-3635-4d64-9dad-388ff5580366 req-c06a4454-5fa1-4240-ada0-7aa3cf2d7ed7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.935435 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-006d0d43-3635-4d64-9dad-388ff5580366 req-c06a4454-5fa1-4240-ada0-7aa3cf2d7ed7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:39.981044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c492ac69-f0eb-42b7-97bb-af792ff24bc6 req-28ac51a0-057d-4ae3-b6ce-7da78d7a1305 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:39.983577 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c492ac69-f0eb-42b7-97bb-af792ff24bc6 req-28ac51a0-057d-4ae3-b6ce-7da78d7a1305 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2041829
Jun 02 16:42:40.016095 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-4df74c03-6c63-4c60-9c87-65c75a2d6f4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:40.017703 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-4df74c03-6c63-4c60-9c87-65c75a2d6f4b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 1096 time: 0.2825761
Jun 02 16:42:40.089510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-006d0d43-3635-4d64-9dad-388ff5580366 req-c06a4454-5fa1-4240-ada0-7aa3cf2d7ed7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:40.090843 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-006d0d43-3635-4d64-9dad-388ff5580366 req-c06a4454-5fa1-4240-ada0-7aa3cf2d7ed7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.5367665
Jun 02 16:42:40.096664 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] For port 0661c8ef-63c2-44b7-97e0-75589941047e, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=0661c8ef-63c2-44b7-97e0-75589941047e,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:42:40.097175 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:40.124114 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c492ac69-f0eb-42b7-97bb-af792ff24bc6 req-a0182548-be9d-4153-9582-ee1d6385b6c8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1009717
Jun 02 16:42:40.281356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Calling delete_port for 0661c8ef-63c2-44b7-97e0-75589941047e owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:42:40.378402 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-006d0d43-3635-4d64-9dad-388ff5580366 req-478e2a41-08e9-4c8a-a3cb-f26fab45aa7b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2767775
Jun 02 16:42:40.389362 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-939b0fa6-40eb-4955-bacf-c1215971d581 req-aaef7b3a-a408-4375-a68c-67132668eaa5 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4486377
Jun 02 16:42:40.517962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-50b5a394-9eb0-432b-86a6-5b98c3c4a508 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:40.520001 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-50b5a394-9eb0-432b-86a6-5b98c3c4a508 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.4531007
Jun 02 16:42:40.842340 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:40.861862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3e8fad34-0ec2-474c-8dbf-71bf6fa75393 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:40.927028 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3', 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', '25af827a-b3ac-4754-ac1f-451d6179e2f4', '0661c8ef-63c2-44b7-97e0-75589941047e'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:42:40.955228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event deleted for resources: {'Port': ['ID=0661c8ef-63c2-44b7-97e0-75589941047e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:40.993779 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.994338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.994604 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.994985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.995340 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.995698 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.996060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.996468 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.996824 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.997192 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.997523 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:40.999041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:41.128545 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a4eeeec-cb21-4ba8-b8cf-b61e5389353d req-f3d08602-4f5f-4aa6-8a7d-752ec11d998b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 210 time: 0.5038297
Jun 02 16:42:41.147080 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:41.169159 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-d98c9881-65f2-42ae-8bd8-f40dc2e9437c service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=14762d04-cafa-47ea-9929-61cd3a540431 HTTP/1.1" status: 200  len: 217 time: 0.2942178
Jun 02 16:42:41.184476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] No DVR routers for this DVR port 0661c8ef-63c2-44b7-97e0-75589941047e on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:42:41.196728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707d2413-dd69-447f-bebb-426391c3b5d5 req-b7419a58-5ae6-4508-852d-8dff29f28b70 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:41.205255 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-707d2413-dd69-447f-bebb-426391c3b5d5 req-b7419a58-5ae6-4508-852d-8dff29f28b70 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.5962017
Jun 02 16:42:41.209256 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:41.212603 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'name': 'network-vif-deleted', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:42:41.215478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e413a21c-5de7-499b-9b16-b947f164b01b" -d '{"events": [{"server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "name": "network-vif-deleted", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:42:41.296010 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b7af373f-dbfb-4535-83aa-34656f2c172d req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "DELETE /v2.0/ports/0661c8ef-63c2-44b7-97e0-75589941047e HTTP/1.1" status: 204  len: 173 time: 1.7285686
Jun 02 16:42:41.345997 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-707d2413-dd69-447f-bebb-426391c3b5d5 req-08257d2a-fe6e-439b-af4d-8f57acca193f tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1391225
Jun 02 16:42:41.401822 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-058b7f93-759e-434b-b7da-87c3bf6dd4a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:41.408405 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-058b7f93-759e-434b-b7da-87c3bf6dd4a1 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.1710782
Jun 02 16:42:41.512186 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:42:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46870c57-b4dd-49fd-a0b8-8156ea1d15ca x-openstack-request-id: req-46870c57-b4dd-49fd-a0b8-8156ea1d15ca {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:42:41.512620 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae6ec0fc-705b-443e-8cc4-74ecc30775f3", "name": "network-vif-deleted", "tag": "0661c8ef-63c2-44b7-97e0-75589941047e", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:42:41.513004 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-46870c57-b4dd-49fd-a0b8-8156ea1d15ca {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:42:41.513647 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae6ec0fc-705b-443e-8cc4-74ecc30775f3', 'name': 'network-vif-deleted', 'tag': '0661c8ef-63c2-44b7-97e0-75589941047e', 'status': 'completed', 'code': 200}
Jun 02 16:42:41.615085 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-dd259362-686e-40f0-a2e8-3c09d3483074 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:41.616755 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-dd259362-686e-40f0-a2e8-3c09d3483074 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1911411
Jun 02 16:42:41.789229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0a2129-8e3b-4924-96d5-ff626b3f3eb6 req-30000006-0f52-44d8-87a3-40e67ee5dd64 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:41.810539 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6a0a2129-8e3b-4924-96d5-ff626b3f3eb6 req-30000006-0f52-44d8-87a3-40e67ee5dd64 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2451985
Jun 02 16:42:41.942152 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6a0a2129-8e3b-4924-96d5-ff626b3f3eb6 req-c4b714b8-7398-4324-a86c-3a97d5a73395 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1295264
Jun 02 16:42:42.001807 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-f00498bd-0ac8-4fe3-9d9f-9765c182c141 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3617179
Jun 02 16:42:42.025650 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e6575f-89f2-4a6a-93a2-891533a65314 req-0d3bbd2e-fbcc-4f75-8e9e-3870ff9cfea5 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:42.033635 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d0e6575f-89f2-4a6a-93a2-891533a65314 req-0d3bbd2e-fbcc-4f75-8e9e-3870ff9cfea5 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1979084
Jun 02 16:42:42.091020 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d0e6575f-89f2-4a6a-93a2-891533a65314 req-1f09623d-d252-4a41-a8fd-cb7d6d36b894 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0562525
Jun 02 16:42:42.411462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ac63afba-9bac-4626-bd11-61d194e1b49b req-f3507b04-bccc-4c6d-8d9b-f8fba7940eb6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:42:42.465069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-ac63afba-9bac-4626-bd11-61d194e1b49b req-f3507b04-bccc-4c6d-8d9b-f8fba7940eb6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:42:42.466768 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac63afba-9bac-4626-bd11-61d194e1b49b req-f3507b04-bccc-4c6d-8d9b-f8fba7940eb6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=ae6ec0fc-705b-443e-8cc4-74ecc30775f3 HTTP/1.1" status: 200  len: 210 time: 0.1443524
Jun 02 16:42:42.718596 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60ecdda-1c39-4346-b2f5-26d3ba551fc0 req-5871ad01-4f79-40b8-8bb6-cad5f1e2e465 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:42.720361 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d60ecdda-1c39-4346-b2f5-26d3ba551fc0 req-5871ad01-4f79-40b8-8bb6-cad5f1e2e465 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1470497
Jun 02 16:42:42.871554 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d60ecdda-1c39-4346-b2f5-26d3ba551fc0 req-c4fde35e-cfe3-4f88-8ff2-e0a1b189d31d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1364541
Jun 02 16:42:42.927360 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bdb1fbd-17ac-44f7-a406-a36ab76fe310 req-97a79998-708b-43e9-b138-00a4a395a0ae service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1773434
Jun 02 16:42:43.337639 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28902bbf-3763-4466-b609-657604a28ecb req-6a64818b-7e31-4748-82b0-742b6539f9ba tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:43.358240 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-28902bbf-3763-4466-b609-657604a28ecb req-6a64818b-7e31-4748-82b0-742b6539f9ba tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1872172
Jun 02 16:42:43.384796 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a66c2086-b09a-4863-8bbf-76b5e8483e1c req-785642a5-37bf-43e4-9db6-151268206e65 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:43.392513 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a66c2086-b09a-4863-8bbf-76b5e8483e1c req-785642a5-37bf-43e4-9db6-151268206e65 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1075950
Jun 02 16:42:43.447513 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a66c2086-b09a-4863-8bbf-76b5e8483e1c req-d0205e07-613e-4318-b947-b8ffdae584b4 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0540261
Jun 02 16:42:43.462722 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-28902bbf-3763-4466-b609-657604a28ecb req-9fb9f00a-918a-4b8b-b7ae-474bbb29a634 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1034596
Jun 02 16:42:44.181136 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 0661c8ef-63c2-44b7-97e0-75589941047e no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:42:44.406840 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bda3619-7cc0-4a3b-9e3e-4c5b33d38812 req-17e12796-804b-450b-bcf9-4e32a087cfd4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:44.420914 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3bda3619-7cc0-4a3b-9e3e-4c5b33d38812 req-17e12796-804b-450b-bcf9-4e32a087cfd4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.2595677
Jun 02 16:42:44.457168 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 0661c8ef-63c2-44b7-97e0-75589941047e {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:42:44.458334 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 0661c8ef-63c2-44b7-97e0-75589941047e not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:42:44.562903 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3bda3619-7cc0-4a3b-9e3e-4c5b33d38812 req-bdfed0bd-8457-4baf-a6e6-7bfe80b866eb tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1395440
Jun 02 16:42:44.966701 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2630d17-e0db-4869-b351-f8e33b947605 req-5eb2ae92-ff2d-4701-8c4a-792387c57183 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:44.970125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c2630d17-e0db-4869-b351-f8e33b947605 req-5eb2ae92-ff2d-4701-8c4a-792387c57183 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.2855780
Jun 02 16:42:44.994073 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65fde837-532a-478a-b133-3d5da63a95ed req-2524b91e-92dd-4982-b244-c68b517dc424 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:44.995786 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-65fde837-532a-478a-b133-3d5da63a95ed req-2524b91e-92dd-4982-b244-c68b517dc424 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2134244
Jun 02 16:42:45.069501 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c2630d17-e0db-4869-b351-f8e33b947605 req-3a0be2be-5b34-4d04-a811-f8fb8b478426 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0901275
Jun 02 16:42:45.092700 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-65fde837-532a-478a-b133-3d5da63a95ed req-d01d11a2-7964-4e6b-97aa-29e12f2dfa39 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0825090
Jun 02 16:42:45.888005 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee0f186-45e5-44d4-b0cf-7e5ecc3ced1a req-7cf46883-a3cb-415e-97c8-ad516e1350c5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:45.890363 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9ee0f186-45e5-44d4-b0cf-7e5ecc3ced1a req-7cf46883-a3cb-415e-97c8-ad516e1350c5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1285450
Jun 02 16:42:45.948835 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9ee0f186-45e5-44d4-b0cf-7e5ecc3ced1a req-0f12f1be-4ddc-46f9-91f5-3c0b2a6b3b94 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499816
Jun 02 16:42:46.434291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf1bc3f-cd54-464f-94f7-74a386e4d3a1 req-c7c764fa-8c8d-46f8-b3dc-6e2998b23d1a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:46.436000 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3cf1bc3f-cd54-464f-94f7-74a386e4d3a1 req-c7c764fa-8c8d-46f8-b3dc-6e2998b23d1a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.2080672
Jun 02 16:42:46.525388 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3cf1bc3f-cd54-464f-94f7-74a386e4d3a1 req-8d99cdf9-b581-4745-85af-7237585d1eea tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0805101
Jun 02 16:42:46.815126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f958e34d-fa16-45ff-866c-cf06124b5cf9 req-fe25ace9-a526-410f-90b1-099668093b84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:46.832555 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f958e34d-fa16-45ff-866c-cf06124b5cf9 req-fe25ace9-a526-410f-90b1-099668093b84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1652317
Jun 02 16:42:46.930632 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f958e34d-fa16-45ff-866c-cf06124b5cf9 req-e400f300-be35-409e-90dd-5774340be810 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0969703
Jun 02 16:42:47.336859 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de663587-6e4d-42b6-b816-3acef9ee74a0 req-74535af1-4035-43c5-87f1-d2ea72b817f3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:47.338586 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de663587-6e4d-42b6-b816-3acef9ee74a0 req-74535af1-4035-43c5-87f1-d2ea72b817f3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2594616
Jun 02 16:42:47.488065 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de663587-6e4d-42b6-b816-3acef9ee74a0 req-dd86c98c-8e7f-47f7-9d2e-a1a53b9b4480 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1283798
Jun 02 16:42:47.868978 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e44039-22a2-4aee-aa3d-7f60b5205810 req-bb56756d-55d4-4cc5-94c9-79121b9154d6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:47.880600 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-03e44039-22a2-4aee-aa3d-7f60b5205810 req-bb56756d-55d4-4cc5-94c9-79121b9154d6 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.1716764
Jun 02 16:42:48.087138 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-03e44039-22a2-4aee-aa3d-7f60b5205810 req-349acf99-26dc-4ab5-997a-1caf8d09059e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2053154
Jun 02 16:42:48.457522 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb03639f-6e47-4c25-9114-1c45f509c90e req-f703e7aa-37f6-4263-8934-3f5ddf2e078b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:48.457522 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bb03639f-6e47-4c25-9114-1c45f509c90e req-f703e7aa-37f6-4263-8934-3f5ddf2e078b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1641726
Jun 02 16:42:48.521185 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bb03639f-6e47-4c25-9114-1c45f509c90e req-925394cc-c3d3-40a9-9808-8243c78eae6b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0996342
Jun 02 16:42:48.778490 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e620bf5-7fb5-4901-b5be-f725d973df6e req-bf1464ea-fea1-499b-9bcb-6a1539ed7176 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:48.780363 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e620bf5-7fb5-4901-b5be-f725d973df6e req-bf1464ea-fea1-499b-9bcb-6a1539ed7176 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.1232915
Jun 02 16:42:48.850851 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7e620bf5-7fb5-4901-b5be-f725d973df6e req-20c6e3db-be55-4d9a-badf-2aa97427fe93 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0632830
Jun 02 16:42:49.367280 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf59b52-af1a-45bb-8e9d-e970878d8991 req-715864c5-e5e7-453c-bd5c-8f79fe843b59 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:49.368961 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-edf59b52-af1a-45bb-8e9d-e970878d8991 req-715864c5-e5e7-453c-bd5c-8f79fe843b59 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0955606
Jun 02 16:42:49.440302 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-edf59b52-af1a-45bb-8e9d-e970878d8991 req-18f9b60d-41e4-482c-8488-23c3361f2aef tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0561118
Jun 02 16:42:49.743086 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e05a67-374c-4aec-8a9e-1043f616d813 req-6f207e10-50c5-4b0f-b1cf-33caad9e04f2 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:49.744597 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b3e05a67-374c-4aec-8a9e-1043f616d813 req-6f207e10-50c5-4b0f-b1cf-33caad9e04f2 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0872669
Jun 02 16:42:49.791479 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b3e05a67-374c-4aec-8a9e-1043f616d813 req-6a872e06-4c48-45b3-9629-dbb14501d552 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407934
Jun 02 16:42:50.054600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65a0973-c222-4090-beb5-b72693d2501b req-f2e1ae6f-ff30-4c76-9bf9-d544ee55eade tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:50.056167 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c65a0973-c222-4090-beb5-b72693d2501b req-f2e1ae6f-ff30-4c76-9bf9-d544ee55eade tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0923595
Jun 02 16:42:50.107088 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c65a0973-c222-4090-beb5-b72693d2501b req-9c2cf017-d2d7-4013-ad08-c119dc8912fa tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447364
Jun 02 16:42:50.659872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afef0b6e-4ead-47ad-9c5f-9098352e9130 req-59b8c695-576d-4e53-a55e-9cb8c7d6f34c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:50.661452 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-afef0b6e-4ead-47ad-9c5f-9098352e9130 req-59b8c695-576d-4e53-a55e-9cb8c7d6f34c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0848093
Jun 02 16:42:50.745904 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-afef0b6e-4ead-47ad-9c5f-9098352e9130 req-f224d2be-c340-4ef8-a7ce-135d660f7165 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0717893
Jun 02 16:42:51.036061 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a762f33-89db-4fa9-870a-9781649ff7cf req-6a9ae526-69db-4be3-a6f4-9b17d3431f78 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:51.048667 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a762f33-89db-4fa9-870a-9781649ff7cf req-6a9ae526-69db-4be3-a6f4-9b17d3431f78 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1096544
Jun 02 16:42:51.098262 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a762f33-89db-4fa9-870a-9781649ff7cf req-da7706ad-c607-421d-9982-f89fb7e98404 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0485442
Jun 02 16:42:51.457712 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05cbf4e-c813-4275-8cf9-52a0627a7631 req-5a84a237-e4ba-4f57-ab3f-64ea8e894802 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:51.459224 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d05cbf4e-c813-4275-8cf9-52a0627a7631 req-5a84a237-e4ba-4f57-ab3f-64ea8e894802 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2231858
Jun 02 16:42:51.512847 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d05cbf4e-c813-4275-8cf9-52a0627a7631 req-0ed6abe8-6be2-4f6d-ba4e-9fbc17a3091a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470183
Jun 02 16:42:51.934740 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdba6582-da7a-437b-9936-b44d111e2cf9 req-ae6cf974-6e48-419f-83fe-f6467d5acefc tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:51.936198 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bdba6582-da7a-437b-9936-b44d111e2cf9 req-ae6cf974-6e48-419f-83fe-f6467d5acefc tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0875654
Jun 02 16:42:51.989466 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bdba6582-da7a-437b-9936-b44d111e2cf9 req-25fbff4a-892a-40d1-b2c0-939a6ee12888 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0474958
Jun 02 16:42:52.298879 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9733d893-b39a-4a48-b5e6-26501885f517 req-cbfb359c-799a-4781-9359-1b7f14413ed1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:52.298879 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9733d893-b39a-4a48-b5e6-26501885f517 req-cbfb359c-799a-4781-9359-1b7f14413ed1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0853300
Jun 02 16:42:52.344038 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9733d893-b39a-4a48-b5e6-26501885f517 req-632d78a9-a8ca-4354-acb8-4fda755420f6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388668
Jun 02 16:42:52.716363 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be6b2bb-0b62-48bf-9e31-ee830d4811a4 req-3657a494-81b5-41dd-b5a7-0ac554317704 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:52.718109 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8be6b2bb-0b62-48bf-9e31-ee830d4811a4 req-3657a494-81b5-41dd-b5a7-0ac554317704 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0901747
Jun 02 16:42:52.765441 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8be6b2bb-0b62-48bf-9e31-ee830d4811a4 req-f858874d-e05c-4fdf-92cc-1832df4f8944 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408201
Jun 02 16:42:52.785731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52902) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:52.846206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Deleting subnet 20e402a0-b7ee-4669-88f8-ad03a86eca35 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:42:52.849457 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:52.903675 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:52.962237 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.278423 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5d8a8b-a2c1-45e5-90f8-b43eb339cf2f req-ac48e1bf-21e4-486e-8ed7-99247d8082c8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:53.279809 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7c5d8a8b-a2c1-45e5-90f8-b43eb339cf2f req-ac48e1bf-21e4-486e-8ed7-99247d8082c8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.1690469
Jun 02 16:42:53.309644 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.317270 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-17750eb8-ec57-4a60-910f-577daf7563f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:53.370883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=20e402a0-b7ee-4669-88f8-ad03a86eca35,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:53.374031 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:53.377917 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7c5d8a8b-a2c1-45e5-90f8-b43eb339cf2f req-762f526d-a705-4037-95ed-0836d22b5f4b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0898030
Jun 02 16:42:53.378198 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.387369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 52908) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:53.387834 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] 10.222.0.25 "DELETE /v2.0/subnets/20e402a0-b7ee-4669-88f8-ad03a86eca35 HTTP/1.1" status: 204  len: 168 time: 0.6008141
Jun 02 16:42:53.495730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.590764 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d73431-258f-43dc-a3c8-62eb9aa4768d req-c01b1ab5-33e8-4fc3-83dd-0b9ad36927ae tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:53.592312 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-15d73431-258f-43dc-a3c8-62eb9aa4768d req-c01b1ab5-33e8-4fc3-83dd-0b9ad36927ae tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0843196
Jun 02 16:42:53.639693 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.654591 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b77785280>,) {'filters': {'network_id': ['02df58b0-f30e-4a68-b09a-14d590111b4f']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:42:53.669092 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-15d73431-258f-43dc-a3c8-62eb9aa4768d req-35f86d81-a5fe-475a-bd0b-9d6c92ea0c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0705683
Jun 02 16:42:53.669300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b77785280>, '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:42:53.669774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b77785280>, '2b0ce5ce-fbb7-47ce-a4be-382c2e52a877') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:42:53.682381 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.701208 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.708649 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Releasing vlan 654 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:42:53.709366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:42:53.725559 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:42:53.811913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.816544 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-699294b8-a7b5-476a-805c-cbd1a0785fe5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:53.836844 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:53.839534 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Pushing event deleted for resources: {'Network': ['ID=02df58b0-f30e-4a68-b09a-14d590111b4f,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:53.848430 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.848738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.849095 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.849448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.858373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.859235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.859881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.860508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.861124 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.863611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.863971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.864320 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:42:53.870529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:53.879111 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-48dfe6b5-afd3-4d63-866e-36cf63c2c592 admin admin] 10.222.0.25 "DELETE /v2.0/networks/02df58b0-f30e-4a68-b09a-14d590111b4f HTTP/1.1" status: 204  len: 168 time: 0.4899576
Jun 02 16:42:53.990756 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2864a9d-cc28-4348-950b-298763c8b89a req-a97cc10b-6399-4e6d-ae5f-0832f10f6ba4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:53.993240 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c2864a9d-cc28-4348-950b-298763c8b89a req-a97cc10b-6399-4e6d-ae5f-0832f10f6ba4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0892503
Jun 02 16:42:54.042853 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c2864a9d-cc28-4348-950b-298763c8b89a req-54b0876b-3114-45c0-a5f5-42f2533278d6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391240
Jun 02 16:42:54.090447 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52918) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:54.139870 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-bcfdf04c-8fc4-4618-8b7b-e8650f2ade0e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a1836d0c3dbd473ca08d38562b52e19d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0478613
Jun 02 16:42:54.142126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 52920) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:42:54.203164 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:54.230174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:54.295832 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:54.300052 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f613e62f-c237-40a3-a8fa-a753add15901 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:42:54.314592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd0a0b0d-fc16-4932-8115-906cb70c4047,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:42:54.317938 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:42:54.331835 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:54.335258 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/dd0a0b0d-fc16-4932-8115-906cb70c4047 HTTP/1.1" status: 204  len: 168 time: 0.1898110
Jun 02 16:42:54.591471 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e26b8c0-1b9a-49bd-8500-2a2a80141b4d req-bc104476-5d5e-43b7-bf42-ba541c1453d8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:54.592973 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e26b8c0-1b9a-49bd-8500-2a2a80141b4d req-bc104476-5d5e-43b7-bf42-ba541c1453d8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0870531
Jun 02 16:42:54.640696 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e26b8c0-1b9a-49bd-8500-2a2a80141b4d req-f21d461d-fcdc-46bd-8e39-a6e70e663a07 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415635
Jun 02 16:42:54.945724 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb5f2b1-7c58-465f-8a82-f3f0a30bfbc9 req-e5495cb3-300f-41e2-a0e8-b0aa5866aa8b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:54.947890 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8bb5f2b1-7c58-465f-8a82-f3f0a30bfbc9 req-e5495cb3-300f-41e2-a0e8-b0aa5866aa8b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1344345
Jun 02 16:42:55.003897 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8bb5f2b1-7c58-465f-8a82-f3f0a30bfbc9 req-5d4f6c04-603b-48e4-89fa-fbdbaac668d3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495982
Jun 02 16:42:55.251200 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5c3608-8692-4ba3-b127-bd9041677831 req-35b79753-d293-42a6-a5d5-0bcaa812d70a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:55.252688 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a5c3608-8692-4ba3-b127-bd9041677831 req-35b79753-d293-42a6-a5d5-0bcaa812d70a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0839207
Jun 02 16:42:55.298380 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a5c3608-8692-4ba3-b127-bd9041677831 req-60e543f5-176a-4f9c-89d0-7e0517fc073a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395734
Jun 02 16:42:55.816506 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-f3aeac41-bb85-4aed-bdb2-2e943bde300b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:55.844688 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7975028-fab7-4941-afc8-08b854cb7a26 req-d501157b-11a6-42e4-9fe4-453ca56e7fe1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:55.853396 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e7975028-fab7-4941-afc8-08b854cb7a26 req-d501157b-11a6-42e4-9fe4-453ca56e7fe1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0994902
Jun 02 16:42:55.905824 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e7975028-fab7-4941-afc8-08b854cb7a26 req-231faffd-1eb5-41e3-9b7b-32a32d865785 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513434
Jun 02 16:42:56.208395 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10126d4e-b293-4017-a88a-ba9f5c8ee49a req-9d89beb9-04c6-4333-85d5-9eb2b4b14bbb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:56.209838 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-10126d4e-b293-4017-a88a-ba9f5c8ee49a req-9d89beb9-04c6-4333-85d5-9eb2b4b14bbb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0919833
Jun 02 16:42:56.256391 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-10126d4e-b293-4017-a88a-ba9f5c8ee49a req-cd9596b2-f340-4991-99a4-e029fcd1d57d tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404162
Jun 02 16:42:56.517953 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde10879-c499-47fe-8ffe-01bd90facfdc req-57e74174-c0b1-4b24-9a76-f93afb9610cb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:56.520220 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bde10879-c499-47fe-8ffe-01bd90facfdc req-57e74174-c0b1-4b24-9a76-f93afb9610cb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0933270
Jun 02 16:42:56.664039 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bde10879-c499-47fe-8ffe-01bd90facfdc req-f4ec781a-a398-4e80-aafc-95dd60474694 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1373589
Jun 02 16:42:57.139498 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cec50f-c849-47c3-98dc-df2299fc9e1b req-9df6d420-f5d6-4faa-a28e-93098d1bdf25 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:57.141416 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a4cec50f-c849-47c3-98dc-df2299fc9e1b req-9df6d420-f5d6-4faa-a28e-93098d1bdf25 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.1010740
Jun 02 16:42:57.204123 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a4cec50f-c849-47c3-98dc-df2299fc9e1b req-2d533da1-c4b4-4963-8844-20078bee19c5 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535300
Jun 02 16:42:57.562046 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95210e99-0828-46de-9920-57c4765822a6 req-10f42eb8-cfc4-460e-a535-442daaa1ab20 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:57.563499 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95210e99-0828-46de-9920-57c4765822a6 req-10f42eb8-cfc4-460e-a535-442daaa1ab20 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.1924105
Jun 02 16:42:57.611069 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95210e99-0828-46de-9920-57c4765822a6 req-25b39e0e-75f1-4a5d-92de-b5f606b72c46 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418696
Jun 02 16:42:57.880964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4949fb06-2bc2-4da5-9320-a9f931673cf6 req-7c0bb4bb-e68b-4b84-8138-e3643d99d524 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:57.886307 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4949fb06-2bc2-4da5-9320-a9f931673cf6 req-7c0bb4bb-e68b-4b84-8138-e3643d99d524 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0946825
Jun 02 16:42:57.941319 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4949fb06-2bc2-4da5-9320-a9f931673cf6 req-c4541a3c-a8a4-4adf-94c3-bcaff4c6d22b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0474684
Jun 02 16:42:58.409978 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4602f081-2cfe-47ae-9b0e-b031c8dec6f6 req-fa3f2cec-d870-4d6c-9244-facbc271a72d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:58.411449 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4602f081-2cfe-47ae-9b0e-b031c8dec6f6 req-fa3f2cec-d870-4d6c-9244-facbc271a72d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0917125
Jun 02 16:42:58.464746 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4602f081-2cfe-47ae-9b0e-b031c8dec6f6 req-6abc2f5b-b543-41ec-8e81-23b369d773ad tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470853
Jun 02 16:42:58.481123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0354dfc0-3ec8-486d-87aa-9dd19afa941e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:58.740883 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:42:58.816682 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-766c56f6-4622-48c7-9099-4af71b6c6bf1 req-50675020-5fc4-4b60-b82b-eebe3bea5b7c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:58.818161 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-766c56f6-4622-48c7-9099-4af71b6c6bf1 req-50675020-5fc4-4b60-b82b-eebe3bea5b7c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0938377
Jun 02 16:42:58.864390 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-766c56f6-4622-48c7-9099-4af71b6c6bf1 req-0aab1118-ea7a-47e1-b46a-d7df4d6a7a1b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385816
Jun 02 16:42:59.140786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0086f5e-f563-4b60-a8f9-ea345b14642f req-71ef2aaa-fd9a-45be-9580-b7986ecfa52d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:59.142227 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b0086f5e-f563-4b60-a8f9-ea345b14642f req-71ef2aaa-fd9a-45be-9580-b7986ecfa52d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0858183
Jun 02 16:42:59.189946 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b0086f5e-f563-4b60-a8f9-ea345b14642f req-ea352795-7ac8-4715-bf2f-49dda3f41e49 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414212
Jun 02 16:42:59.663225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23995fa2-0534-4343-9753-14dca850d47d req-384760ab-7fb1-46bd-8db8-0382dad0b77b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:42:59.665005 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23995fa2-0534-4343-9753-14dca850d47d req-384760ab-7fb1-46bd-8db8-0382dad0b77b tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0822067
Jun 02 16:42:59.711119 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23995fa2-0534-4343-9753-14dca850d47d req-144817a8-5ee4-4ee3-80ed-1cb02fff6ac7 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400786
Jun 02 16:42:59.869159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 14762d04-cafa-47ea-9929-61cd3a540431 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:43:00.012574 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=14762d04-cafa-47ea-9929-61cd3a540431,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:00.025842 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '14762d04-cafa-47ea-9929-61cd3a540431', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'port_id': '14762d04-cafa-47ea-9929-61cd3a540431', 'mac_address': 'fa:16:3e:19:ed:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 688, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:43:00.061108 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b009b104-0741-4675-8bb7-d66079f97f8a req-874a6690-97e6-429d-9de1-9e416f99e14c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:00.062577 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b009b104-0741-4675-8bb7-d66079f97f8a req-874a6690-97e6-429d-9de1-9e416f99e14c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 943 time: 0.0885134
Jun 02 16:43:00.081033 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:00.097781 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 14762d04-cafa-47ea-9929-61cd3a540431 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:43:00.106949 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b009b104-0741-4675-8bb7-d66079f97f8a req-2f8468ab-1ebd-4da2-b58b-404ec7ed5c89 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385342
Jun 02 16:43:00.117794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=14762d04-cafa-47ea-9929-61cd3a540431,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:00.124753 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:00.126567 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-16e74ef3-70b4-4dc8-8fc6-992d44999a8f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:00.214759 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:00.220915 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:00.228945 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.229372 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.229887 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.230092 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.230446 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.231073 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.231391 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.231805 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.232167 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.232515 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.232862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.233172 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:00.237835 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:00.393820 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cc1082-f41c-42a8-9f5f-9b59ef02d682 req-e9c51771-7f38-4313-a338-853bbe1278b1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:00.397697 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-63cc1082-f41c-42a8-9f5f-9b59ef02d682 req-e9c51771-7f38-4313-a338-853bbe1278b1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0851221
Jun 02 16:43:00.449436 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-63cc1082-f41c-42a8-9f5f-9b59ef02d682 req-f1f856be-2170-4ee2-b2df-e8e1a095a229 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0480745
Jun 02 16:43:00.904885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75111984-44d8-407a-8687-b87abb4deda0 req-b0e9755f-5f79-4e44-978a-ca008221c681 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:00.906333 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-75111984-44d8-407a-8687-b87abb4deda0 req-b0e9755f-5f79-4e44-978a-ca008221c681 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.0838888
Jun 02 16:43:00.950834 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-75111984-44d8-407a-8687-b87abb4deda0 req-be88bf0f-f3b6-423f-861e-a7e6916a2751 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385807
Jun 02 16:43:01.216847 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-18a289f1-c9f6-441f-a0ed-c84813945b27 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0812831
Jun 02 16:43:01.323695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-e499855b-f390-469c-a581-351f2ab92b9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.325374 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-e499855b-f390-469c-a581-351f2ab92b9c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2a331932fba240f7a0fbb0b93203268c&device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 1099 time: 0.0747039
Jun 02 16:43:01.358287 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8489d8d1-b52c-4eb6-a2ce-2c370c3995b7 req-964389c3-4a6e-4926-9701-7aa1c600bd3e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.359923 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8489d8d1-b52c-4eb6-a2ce-2c370c3995b7 req-964389c3-4a6e-4926-9701-7aa1c600bd3e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.1380827
Jun 02 16:43:01.377147 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-cf2530b1-adb1-467c-889f-5bc7469550e1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.378570 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-cf2530b1-adb1-467c-889f-5bc7469550e1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.1249108
Jun 02 16:43:01.467834 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['14762d04-cafa-47ea-9929-61cd3a540431'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:01.486022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-df81fb82-60d7-4c64-a9c9-653f974095cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.487942 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-df81fb82-60d7-4c64-a9c9-653f974095cb service neutron] 10.222.0.20 "GET /v2.0/networks?id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 200  len: 919 time: 0.1412446
Jun 02 16:43:01.499788 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8489d8d1-b52c-4eb6-a2ce-2c370c3995b7 req-1189b02e-b61d-4d59-bdcf-6da18dac1cd6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1293440
Jun 02 16:43:01.579707 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-814daa68-5f89-437d-a9db-efe30a481f8f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739 HTTP/1.1" status: 200  len: 217 time: 0.0807567
Jun 02 16:43:01.667628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Deleting port 25af827a-b3ac-4754-ac1f-451d6179e2f4 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:01.668836 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:01.747395 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-0f9f793c-dd13-4361-b080-e0dcb5edff11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.748762 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-0f9f793c-dd13-4361-b080-e0dcb5edff11 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 200  len: 858 time: 0.1595449
Jun 02 16:43:01.850498 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:01.857187 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] For port 25af827a-b3ac-4754-ac1f-451d6179e2f4, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=25af827a-b3ac-4754-ac1f-451d6179e2f4,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:01.859157 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:01.861585 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-e95c968a-d1b5-4c64-acfb-18ebe7f46048 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1037848
Jun 02 16:43:01.872194 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9540f63d-16ff-45f9-9449-9b003b6b0f18 req-3ae41740-d88f-4bb7-843a-7ef82e3e9e9f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:01.873930 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9540f63d-16ff-45f9-9449-9b003b6b0f18 req-3ae41740-d88f-4bb7-843a-7ef82e3e9e9f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.2210376
Jun 02 16:43:01.959311 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9540f63d-16ff-45f9-9449-9b003b6b0f18 req-fa78ae76-1400-4011-8f4e-d86546a75e7c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0659518
Jun 02 16:43:02.038086 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Calling delete_port for 25af827a-b3ac-4754-ac1f-451d6179e2f4 owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:02.057273 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-0ac19cd7-3586-48d7-88c0-670d67ed8c60 service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1821506
Jun 02 16:43:02.216747 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afff3a8a-ea29-4697-a280-5fc54c6cf6b4 req-552a2eb7-db5b-407b-85eb-838b19599a5c service neutron] 10.222.0.20 "GET /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1413846
Jun 02 16:43:02.222998 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:02.228949 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:02.378963 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event deleted for resources: {'Port': ['ID=25af827a-b3ac-4754-ac1f-451d6179e2f4,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:02.405942 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:02.449757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b04915-15c1-442f-ab3e-c2bbec28ea5d req-66c98e98-f1a0-4c07-a371-4c67873dd650 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:02.451216 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-99b04915-15c1-442f-ab3e-c2bbec28ea5d req-66c98e98-f1a0-4c07-a371-4c67873dd650 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 945 time: 0.3565948
Jun 02 16:43:02.478831 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] No DVR routers for this DVR port 25af827a-b3ac-4754-ac1f-451d6179e2f4 on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:02.483375 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:02.485796 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'name': 'network-vif-deleted', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:02.488072 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-244ee8ff-708a-4cf4-861e-2a94a4bd5ca9" -d '{"events": [{"server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "name": "network-vif-deleted", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:02.513551 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-288cf5eb-b582-4b54-b215-c5097bb2ad86 req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "DELETE /v2.0/ports/25af827a-b3ac-4754-ac1f-451d6179e2f4 HTTP/1.1" status: 204  len: 173 time: 1.1198633
Jun 02 16:43:02.518228 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-99b04915-15c1-442f-ab3e-c2bbec28ea5d req-15d261de-223b-4731-9cdf-9037e768e07a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610743
Jun 02 16:43:02.572144 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8980a92-957c-4347-b602-02063f226562 x-openstack-request-id: req-c8980a92-957c-4347-b602-02063f226562 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:02.572492 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6486b72-9943-4916-9659-063dbbeef979", "name": "network-vif-deleted", "tag": "25af827a-b3ac-4754-ac1f-451d6179e2f4", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:02.572742 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c8980a92-957c-4347-b602-02063f226562 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:02.573198 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6486b72-9943-4916-9659-063dbbeef979', 'name': 'network-vif-deleted', 'tag': '25af827a-b3ac-4754-ac1f-451d6179e2f4', 'status': 'completed', 'code': 200}
Jun 02 16:43:02.744164 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be92783-23cc-4cc5-96c0-1b563d695906 req-576d2466-75f1-4a9c-b5bf-a3ab2f3dc9a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:02.745625 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4be92783-23cc-4cc5-96c0-1b563d695906 req-576d2466-75f1-4a9c-b5bf-a3ab2f3dc9a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.0833123
Jun 02 16:43:02.792240 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4be92783-23cc-4cc5-96c0-1b563d695906 req-630aa990-c8db-4eee-a49a-d8311ea0116a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406406
Jun 02 16:43:03.169666 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd72689-0843-4c09-aee9-acf033e148ae req-8575dc35-71fc-44a3-a863-db2084962ad7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:03.171159 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9dd72689-0843-4c09-aee9-acf033e148ae req-8575dc35-71fc-44a3-a863-db2084962ad7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0846460
Jun 02 16:43:03.219841 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9dd72689-0843-4c09-aee9-acf033e148ae req-e41069f5-fd36-41e7-ae98-7c99d14cc997 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426686
Jun 02 16:43:03.671537 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-20080eed-d025-482a-b96c-06f770ab1f51 req-eea1dc52-8ecb-492c-863e-6fba1a0ba09f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:43:03.689347 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-20080eed-d025-482a-b96c-06f770ab1f51 req-eea1dc52-8ecb-492c-863e-6fba1a0ba09f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:43:03.690680 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-20080eed-d025-482a-b96c-06f770ab1f51 req-eea1dc52-8ecb-492c-863e-6fba1a0ba09f tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0621550
Jun 02 16:43:03.736329 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:04.010680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a65060-4cbb-4715-ade6-75b4d3cf3d64 req-67d70095-cd81-45c1-994a-12886cb87d91 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:04.012232 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95a65060-4cbb-4715-ade6-75b4d3cf3d64 req-67d70095-cd81-45c1-994a-12886cb87d91 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.0998204
Jun 02 16:43:04.060563 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95a65060-4cbb-4715-ade6-75b4d3cf3d64 req-13d9a508-d55e-438a-b68f-5a3352f6f9e5 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409133
Jun 02 16:43:04.424180 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfc8944-6ff5-42db-8e0e-c7ea0129c6d5 req-155af77a-5c27-4a06-8aee-81d21502567f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:04.425680 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3bfc8944-6ff5-42db-8e0e-c7ea0129c6d5 req-155af77a-5c27-4a06-8aee-81d21502567f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0900121
Jun 02 16:43:04.472112 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3bfc8944-6ff5-42db-8e0e-c7ea0129c6d5 req-c0495533-eca7-4067-a14c-8b9412de9730 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405722
Jun 02 16:43:04.850240 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dc83126d-01fe-4269-a4aa-20bbcfeec824 req-feb7b720-f541-494f-a8c8-a603c0f35e3d tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0455506
Jun 02 16:43:05.255282 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec77961-6236-4a04-b8a5-7c732d51822b req-ba04decc-c0a5-4d6f-bb3d-8d6724d390da tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:05.256796 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dec77961-6236-4a04-b8a5-7c732d51822b req-ba04decc-c0a5-4d6f-bb3d-8d6724d390da tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.0839512
Jun 02 16:43:05.303559 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dec77961-6236-4a04-b8a5-7c732d51822b req-0e91340f-bd7b-461e-a50b-f356da0c284a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403767
Jun 02 16:43:05.677764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73450ea9-cbe3-4cfb-8d9f-d5427ae55423 req-0a7459c6-f20e-4e38-9a50-a9f114c8242f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:05.679190 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-73450ea9-cbe3-4cfb-8d9f-d5427ae55423 req-0a7459c6-f20e-4e38-9a50-a9f114c8242f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0926447
Jun 02 16:43:05.726679 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-73450ea9-cbe3-4cfb-8d9f-d5427ae55423 req-049a60fc-54ac-42a2-ba50-da546da11a75 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408843
Jun 02 16:43:05.776282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 25af827a-b3ac-4754-ac1f-451d6179e2f4 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:05.818573 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 25af827a-b3ac-4754-ac1f-451d6179e2f4 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:05.818921 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 25af827a-b3ac-4754-ac1f-451d6179e2f4 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:06.028091 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-781f7bb9-fa6c-4930-8ae0-61fc120ce1bf req-bbf96d2d-ac2b-4cb1-986d-5705a38e369c tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=b6486b72-9943-4916-9659-063dbbeef979 HTTP/1.1" status: 200  len: 210 time: 0.0468738
Jun 02 16:43:06.052545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3', 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:06.533025 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e16268-9159-4eca-9d5f-73d8989e1afd req-70fdcce1-c8bf-4484-b091-bec51101cf98 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:06.534564 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a9e16268-9159-4eca-9d5f-73d8989e1afd req-70fdcce1-c8bf-4484-b091-bec51101cf98 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.1132762
Jun 02 16:43:06.590978 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a9e16268-9159-4eca-9d5f-73d8989e1afd req-ee1d9b52-ccaa-49a1-8dde-e49a9fa9d4a8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0499926
Jun 02 16:43:06.994716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb612327-b63d-43b4-a5ee-476d5d4c2e00 req-9843ca60-02c6-492d-8455-4d31f5827d31 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:06.996125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb612327-b63d-43b4-a5ee-476d5d4c2e00 req-9843ca60-02c6-492d-8455-4d31f5827d31 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0821269
Jun 02 16:43:07.041590 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb612327-b63d-43b4-a5ee-476d5d4c2e00 req-6d23140c-3069-47a8-8e59-9f647efaca2c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392156
Jun 02 16:43:07.610139 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 14762d04-cafa-47ea-9929-61cd3a540431 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:43:07.656427 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9656a486-e149-4103-a188-44f76d662cd5 req-2503577a-7a9f-440f-88d1-815b83bb2664 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:07.657948 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9656a486-e149-4103-a188-44f76d662cd5 req-2503577a-7a9f-440f-88d1-815b83bb2664 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.0916202
Jun 02 16:43:07.680981 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 14762d04-cafa-47ea-9929-61cd3a540431 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:43:07.686211 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 14762d04-cafa-47ea-9929-61cd3a540431 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:43:07.686577 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:07.705221 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9656a486-e149-4103-a188-44f76d662cd5 req-1b02d286-781b-46d2-827c-0adb6b4d8983 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408623
Jun 02 16:43:07.816378 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:07.846814 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:07.849665 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d8d29ed-faae-4ce4-8fa9-97bdd42a468c" -d '{"events": [{"server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "name": "network-vif-plugged", "status": "completed", "tag": "14762d04-cafa-47ea-9929-61cd3a540431"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:07.857937 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=14762d04-cafa-47ea-9929-61cd3a540431,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:07.864204 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:07.867239 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:07.930391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c1b580-ac92-4328-953a-aee2864f9a4c req-6f8a730d-91fb-4b12-914a-bbe524856376 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:07.934065 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-31c1b580-ac92-4328-953a-aee2864f9a4c req-6f8a730d-91fb-4b12-914a-bbe524856376 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 944 time: 0.1158381
Jun 02 16:43:07.939896 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:07.946133 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:07.987946 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-31c1b580-ac92-4328-953a-aee2864f9a4c req-e821c974-0776-427b-8980-64b0a7bbf986 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0493884
Jun 02 16:43:08.009914 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec244cd2-a9e7-4bd5-bcf0-44aae4a19e44 req-1d4d9cfe-e885-4f31-afb7-5b01a6a1b499 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:08.012083 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ec244cd2-a9e7-4bd5-bcf0-44aae4a19e44 req-1d4d9cfe-e885-4f31-afb7-5b01a6a1b499 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1142154
Jun 02 16:43:08.042227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebd3af43-3143-4b66-8991-e3217b041feb x-openstack-request-id: req-ebd3af43-3143-4b66-8991-e3217b041feb {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:08.043320 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "name": "network-vif-plugged", "status": "completed", "tag": "14762d04-cafa-47ea-9929-61cd3a540431", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:08.043644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ebd3af43-3143-4b66-8991-e3217b041feb {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:08.044181 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431', 'code': 200}
Jun 02 16:43:08.058464 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ec244cd2-a9e7-4bd5-bcf0-44aae4a19e44 req-b9ead7d3-7920-4789-8328-a030fcae84ea tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405653
Jun 02 16:43:08.240441 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408ada43-f7c1-4535-a174-25b37f5eeea4 req-d80e6f1f-9dec-4dfc-8e72-964f5541a8f1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:08.241955 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-408ada43-f7c1-4535-a174-25b37f5eeea4 req-d80e6f1f-9dec-4dfc-8e72-964f5541a8f1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0851092
Jun 02 16:43:08.288369 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-408ada43-f7c1-4535-a174-25b37f5eeea4 req-f5993da4-924e-45ce-99c6-120ae17a87a2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405376
Jun 02 16:43:08.924101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b068581-54cd-45d7-a90f-88fb28ba7aca req-9f6d5539-7cd1-45b7-b035-b1bb15703c89 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:08.925547 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1b068581-54cd-45d7-a90f-88fb28ba7aca req-9f6d5539-7cd1-45b7-b035-b1bb15703c89 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.1007812
Jun 02 16:43:08.971342 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1b068581-54cd-45d7-a90f-88fb28ba7aca req-6c8e7315-5e0b-423e-a62b-0632657d2a14 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399077
Jun 02 16:43:09.187999 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84056b0-9ba7-47b9-ac7e-b71cb57019e6 req-65c15be4-93b4-426c-821f-e4c350a5adbc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:09.189572 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a84056b0-9ba7-47b9-ac7e-b71cb57019e6 req-65c15be4-93b4-426c-821f-e4c350a5adbc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.0920765
Jun 02 16:43:09.239321 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a84056b0-9ba7-47b9-ac7e-b71cb57019e6 req-a6b4ae4e-1724-47ef-b6cd-e676d3ac08c8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0438299
Jun 02 16:43:09.421723 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3e672f-333c-4a9d-a820-9b188956bf11 req-a3327fab-41b9-46c3-9879-0d261b17c202 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:09.423447 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9a3e672f-333c-4a9d-a820-9b188956bf11 req-a3327fab-41b9-46c3-9879-0d261b17c202 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0824351
Jun 02 16:43:09.471063 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9a3e672f-333c-4a9d-a820-9b188956bf11 req-85f861e1-b86a-4a43-bc2b-04efd039d930 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416203
Jun 02 16:43:09.659014 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc38f3b-10df-4f6f-b43e-6ac6f0ec5061 req-a7e02276-210b-4cfd-b546-01eaf2716499 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:09.660649 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4fc38f3b-10df-4f6f-b43e-6ac6f0ec5061 req-a7e02276-210b-4cfd-b546-01eaf2716499 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0875149
Jun 02 16:43:09.709040 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4fc38f3b-10df-4f6f-b43e-6ac6f0ec5061 req-ef3323cf-12b6-4601-b02e-5c0ff8e4c71c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401044
Jun 02 16:43:10.168325 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1673161-a424-4cfe-96e3-071222cc2fee req-701103ce-8c6d-4e3b-82da-c3f745af7f4e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:10.169791 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d1673161-a424-4cfe-96e3-071222cc2fee req-701103ce-8c6d-4e3b-82da-c3f745af7f4e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.0895972
Jun 02 16:43:10.234536 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d1673161-a424-4cfe-96e3-071222cc2fee req-d821d908-4f0e-4b42-b134-64434359c436 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563993
Jun 02 16:43:10.456809 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ece7b18-aa01-4522-b2b8-061ee66c283d req-64ed7828-c201-4d36-9ff2-4c9a32767786 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:10.458337 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1ece7b18-aa01-4522-b2b8-061ee66c283d req-64ed7828-c201-4d36-9ff2-4c9a32767786 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.1086340
Jun 02 16:43:10.507142 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1ece7b18-aa01-4522-b2b8-061ee66c283d req-06b0d85c-9b67-4ced-906f-b4a41702a4b1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429955
Jun 02 16:43:10.693434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c7afb9-9a5c-4360-bb98-0741c696eff2 req-a101e178-896e-49f1-9274-d9eb5c9dbc2b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:10.694893 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c6c7afb9-9a5c-4360-bb98-0741c696eff2 req-a101e178-896e-49f1-9274-d9eb5c9dbc2b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0870800
Jun 02 16:43:10.753882 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c6c7afb9-9a5c-4360-bb98-0741c696eff2 req-07d843b2-f530-4375-b07d-a8505e1c1b28 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501840
Jun 02 16:43:10.941985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe1bb28-f4d2-4fea-b693-d5ff94369d92 req-2b871997-ddfe-4b64-acc7-775d736bc53e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:10.943420 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dbe1bb28-f4d2-4fea-b693-d5ff94369d92 req-2b871997-ddfe-4b64-acc7-775d736bc53e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 943 time: 0.0885746
Jun 02 16:43:10.993595 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dbe1bb28-f4d2-4fea-b693-d5ff94369d92 req-96169fb6-ab24-4bac-b23f-faf5ea363f2c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414879
Jun 02 16:43:11.017413 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:43:11.182274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:11.195732 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'mac_address': 'fa:16:3e:1b:d9:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:43:11.255054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:11.273353 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:43:11.290450 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:11.309805 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:11.313889 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:11.392017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=9']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:11.395553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:11.622836 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929598bd-bbc2-4ea7-b520-cbe1f8add7ae req-4eab2a2f-b309-4ff1-a4b0-686640266e79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:11.624439 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-929598bd-bbc2-4ea7-b520-cbe1f8add7ae req-4eab2a2f-b309-4ff1-a4b0-686640266e79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.2720814
Jun 02 16:43:11.627871 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8ce612-d2a6-422c-a4e7-3f595a0c81bf req-77786eb0-08a2-47d8-b1af-0649048e5dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:11.629498 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0f8ce612-d2a6-422c-a4e7-3f595a0c81bf req-77786eb0-08a2-47d8-b1af-0649048e5dd0 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 1098 time: 0.2232492
Jun 02 16:43:11.680872 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['cf7356d3-b193-4ccb-a580-fe9976ab37df'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:11.708418 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0f8ce612-d2a6-422c-a4e7-3f595a0c81bf req-b65921ac-5ce7-4f7d-8235-7ab6bdd59db3 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0614705
Jun 02 16:43:11.720855 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca0975a-fdc8-4e7a-84e2-c573506473a4 req-90f41a6f-f9af-4e34-863f-43e369c4c472 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:11.722396 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-929598bd-bbc2-4ea7-b520-cbe1f8add7ae req-8767ecb2-03e3-4fbd-a83f-fdb0b0972052 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0904388
Jun 02 16:43:11.724926 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bca0975a-fdc8-4e7a-84e2-c573506473a4 req-90f41a6f-f9af-4e34-863f-43e369c4c472 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.0909114
Jun 02 16:43:11.780688 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bca0975a-fdc8-4e7a-84e2-c573506473a4 req-ca796227-d306-45c4-92b1-2e54c3e114fc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442607
Jun 02 16:43:11.950889 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2659bc6-3073-4c31-bc98-7551860f8a2f req-52755e95-6b8e-47eb-a150-8675a5719212 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:11.952451 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b2659bc6-3073-4c31-bc98-7551860f8a2f req-52755e95-6b8e-47eb-a150-8675a5719212 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0834675
Jun 02 16:43:11.997350 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b2659bc6-3073-4c31-bc98-7551860f8a2f req-9f0db458-3b8d-429b-8ff7-56cb4a986b49 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391388
Jun 02 16:43:12.216449 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b967eb4-2f7a-46c9-b4e7-77f410176fab req-8b4419d4-800d-47ed-9aa3-00ed2d176c8f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:12.217958 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0b967eb4-2f7a-46c9-b4e7-77f410176fab req-8b4419d4-800d-47ed-9aa3-00ed2d176c8f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.0929983
Jun 02 16:43:12.345484 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0b967eb4-2f7a-46c9-b4e7-77f410176fab req-0c0749e7-a88b-45a9-bb56-011fc083b2b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1214306
Jun 02 16:43:12.908845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a45c9f-6bcc-4031-bec4-58b71fe14d64 req-f51ec744-9ea4-4dad-91ec-afab81e8924a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:12.910488 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b8a45c9f-6bcc-4031-bec4-58b71fe14d64 req-f51ec744-9ea4-4dad-91ec-afab81e8924a tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.0887535
Jun 02 16:43:12.966082 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b8a45c9f-6bcc-4031-bec4-58b71fe14d64 req-e1c15625-0a24-4758-887d-69e21ba3fefc tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496325
Jun 02 16:43:13.132678 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-dc06a5ec-2710-41ed-9855-09a028c93d4e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:13.134273 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-dc06a5ec-2710-41ed-9855-09a028c93d4e tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 945 time: 0.1257412
Jun 02 16:43:13.206610 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346ee812-fe93-4219-9c31-21780cfab3f0 req-ad3034c5-ff03-4dc2-9dfa-3fc30c6aa994 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:13.208166 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-346ee812-fe93-4219-9c31-21780cfab3f0 req-ad3034c5-ff03-4dc2-9dfa-3fc30c6aa994 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.1354311
Jun 02 16:43:13.262948 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-346ee812-fe93-4219-9c31-21780cfab3f0 req-48926ca0-095a-44b4-af8b-c29821cc8678 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0485587
Jun 02 16:43:13.339296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e93500e-41f7-4bf4-934d-e5383c7b4c01 req-322d1bad-9b22-4794-8f7f-35049a781303 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:13.340736 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e93500e-41f7-4bf4-934d-e5383c7b4c01 req-322d1bad-9b22-4794-8f7f-35049a781303 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1617427
Jun 02 16:43:13.370147 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Deleting port aa2c51f5-ce26-4924-b07d-2fd35ef89adb {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:13.370491 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:13.430133 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e93500e-41f7-4bf4-934d-e5383c7b4c01 req-cecbecdb-c6f5-4288-aaf9-f399c3f4bc50 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0824311
Jun 02 16:43:13.527619 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] For port aa2c51f5-ce26-4924-b07d-2fd35ef89adb, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:13.527886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:13.543331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7785ab-17a9-4964-a383-f3b72b87e27e req-cc5267ce-8b35-4ccc-93ce-6faf8c8e181b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:13.544815 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1e7785ab-17a9-4964-a383-f3b72b87e27e req-cc5267ce-8b35-4ccc-93ce-6faf8c8e181b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 944 time: 0.0828099
Jun 02 16:43:13.556004 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:43:13.596289 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1e7785ab-17a9-4964-a383-f3b72b87e27e req-956cd73d-dc3c-4b19-8da5-11abaaa24cb2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420442
Jun 02 16:43:13.651756 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Calling delete_port for aa2c51f5-ce26-4924-b07d-2fd35ef89adb owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:13.771051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:13.778902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b8e8b370-b472-4bbd-a66a-a7859f3730c4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:13.793113 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3', 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:13.822976 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event deleted for resources: {'Port': ['ID=aa2c51f5-ce26-4924-b07d-2fd35ef89adb,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:13.825878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:13.888499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:43:13.898965 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] No DVR routers for this DVR port aa2c51f5-ce26-4924-b07d-2fd35ef89adb on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:13.902403 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:13.905290 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'name': 'network-vif-deleted', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:13.907709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f99d35c-b1f1-40ec-918b-96337ff5c4e7" -d '{"events": [{"server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "name": "network-vif-deleted", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:13.923377 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5c95686-24f3-4765-b0af-a36c7fc3ae1c req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "DELETE /v2.0/ports/aa2c51f5-ce26-4924-b07d-2fd35ef89adb HTTP/1.1" status: 204  len: 173 time: 0.7800245
Jun 02 16:43:13.969718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbadcc0d-2f34-416d-aacb-34c1ebf76b81 x-openstack-request-id: req-dbadcc0d-2f34-416d-aacb-34c1ebf76b81 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:13.970705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0", "name": "network-vif-deleted", "tag": "aa2c51f5-ce26-4924-b07d-2fd35ef89adb", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:13.971082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-dbadcc0d-2f34-416d-aacb-34c1ebf76b81 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:13.971623 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0', 'name': 'network-vif-deleted', 'tag': 'aa2c51f5-ce26-4924-b07d-2fd35ef89adb', 'status': 'completed', 'code': 200}
Jun 02 16:43:14.019369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port cf7356d3-b193-4ccb-a580-fe9976ab37df triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:43:14.019745 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:14.117699 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c302a094-9648-49c6-a71f-86d825a8c135 req-87995d3e-9c63-406a-a583-dc1bf132c2fe tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=bebdf4e9-3e0c-4de7-8cbc-813ba54c2cc0 HTTP/1.1" status: 200  len: 210 time: 0.0432510
Jun 02 16:43:14.146025 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:14.173000 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:14.175334 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab6d2110-bab6-46cb-a263-df59beb336f6" -d '{"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:14.182986 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:14.188349 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:14.190435 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:14.226367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6da99d48-13b2-49ca-97d8-d32723f4fd4b x-openstack-request-id: req-6da99d48-13b2-49ca-97d8-d32723f4fd4b {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:14.226795 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-plugged", "status": "completed", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:14.227083 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-6da99d48-13b2-49ca-97d8-d32723f4fd4b {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:14.227477 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'code': 200}
Jun 02 16:43:14.260988 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=10']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:14.263919 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:14.462289 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6873ea53-f91a-42f9-a752-f63c4877d6c1 req-f2a343a7-0b24-4ee4-b7a0-3a60271d1588 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:14.463910 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6873ea53-f91a-42f9-a752-f63c4877d6c1 req-f2a343a7-0b24-4ee4-b7a0-3a60271d1588 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.0917027
Jun 02 16:43:14.511031 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6873ea53-f91a-42f9-a752-f63c4877d6c1 req-83ee8fea-99aa-41ae-a4c4-a7521d8bfed0 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401762
Jun 02 16:43:14.637995 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cd25237-bf78-436a-a41b-a4ac016e9394 req-a6770c38-c2f4-4782-bf7f-b8280e9e60a5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:14.639457 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9cd25237-bf78-436a-a41b-a4ac016e9394 req-a6770c38-c2f4-4782-bf7f-b8280e9e60a5 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.0991535
Jun 02 16:43:14.689032 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9cd25237-bf78-436a-a41b-a4ac016e9394 req-34ec69d0-097b-467e-ad02-3929749861e7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427575
Jun 02 16:43:14.756312 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d90067-da46-4c57-a456-a794ed696f5b req-7a44edca-ece6-4929-a8eb-ffe3611cee44 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:14.757896 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c2d90067-da46-4c57-a456-a794ed696f5b req-7a44edca-ece6-4929-a8eb-ffe3611cee44 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.1317153
Jun 02 16:43:14.840914 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c2d90067-da46-4c57-a456-a794ed696f5b req-d998d9c3-71b4-4197-996c-174f0a31204b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0727932
Jun 02 16:43:14.855119 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53302) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:14.904423 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1dc9e7-f1fd-4392-8bf4-782583f3d93a req-b1e9ffdb-1a6d-46b8-87bb-be364fa1ea8e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:14.905791 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fe1dc9e7-f1fd-4392-8bf4-782583f3d93a req-b1e9ffdb-1a6d-46b8-87bb-be364fa1ea8e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0842371
Jun 02 16:43:14.974977 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc2d235-9a29-4d56-bc10-cd4fbb7859c2 req-bde4246c-afea-4844-9c4f-47374a5c4f81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:14.976472 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3dc2d235-9a29-4d56-bc10-cd4fbb7859c2 req-bde4246c-afea-4844-9c4f-47374a5c4f81 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 1099 time: 0.0713227
Jun 02 16:43:14.999142 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fe1dc9e7-f1fd-4392-8bf4-782583f3d93a req-08cab7f1-c0b2-4ea6-94eb-2d16ceb64fc0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0579176
Jun 02 16:43:15.025188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35cb32d9-8e67-4614-b993-aa9480da855c req-b602244a-1c97-4aea-9745-17ec75662ce4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:15.028038 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-35cb32d9-8e67-4614-b993-aa9480da855c req-b602244a-1c97-4aea-9745-17ec75662ce4 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 946 time: 0.1213343
Jun 02 16:43:15.099677 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3dc2d235-9a29-4d56-bc10-cd4fbb7859c2 req-853bc8f7-8549-4f85-8c62-b5acd0ea51d0 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1148283
Jun 02 16:43:15.126404 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae793fe2-7f37-4cdf-a428-4bf904daed78 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:15.127860 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ae793fe2-7f37-4cdf-a428-4bf904daed78 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 1093 time: 0.2715793
Jun 02 16:43:15.130911 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53308) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:15.135353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'port_id': '14762d04-cafa-47ea-9929-61cd3a540431', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address': '172.20.0.5'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:43:15.141267 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:15.145718 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:floatingip and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:15.148840 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:15.154876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:15.167558 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.175225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Deleting port 5e1e9de7-d161-410e-9e7e-a9f74a701739 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:15.175566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.319016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.414946 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] For port 5e1e9de7-d161-410e-9e7e-a9f74a701739, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=5e1e9de7-d161-410e-9e7e-a9f74a701739,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:15.415310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.466934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.27.0.114 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/e164cbec-6e1d-4818-9119-889c318d5178) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:43:15.544016 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Calling delete_port for 5e1e9de7-d161-410e-9e7e-a9f74a701739 owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:15.620383 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.656846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.661891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e14ce448-1384-4738-b3e1-2b18505fbcb1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:15.663353 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.669131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-94c64ddd-c69e-4abb-a9a3-2b69727cd0a9 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:15.678002 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['b28c3bf7-7098-48bc-8c31-211ba369c5bf', '5e1e9de7-d161-410e-9e7e-a9f74a701739'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:15.719315 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Pushing event deleted for resources: {'Port': ['ID=5e1e9de7-d161-410e-9e7e-a9f74a701739,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:15.728296 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:43:15.731315 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:43:15.735405 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:43:15.741512 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:15.771673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=e164cbec-6e1d-4818-9119-889c318d5178,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:15.776051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:15.947332 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] No DVR routers for this DVR port 5e1e9de7-d161-410e-9e7e-a9f74a701739 on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:15.949800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:15.967808 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-35cb32d9-8e67-4614-b993-aa9480da855c req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "DELETE /v2.0/ports/5e1e9de7-d161-410e-9e7e-a9f74a701739 HTTP/1.1" status: 204  len: 173 time: 0.9309170
Jun 02 16:43:15.972609 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'name': 'network-vif-deleted', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:15.975162 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a011f40-1f2f-417a-8ac4-34a0982bc52a" -d '{"events": [{"server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "name": "network-vif-deleted", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:16.016837 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c5e4d555-b992-469d-82ea-9b70c36e63b4 req-2d4b4ec4-1ca9-40e2-be84-37ac67695d70 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=f86a1088-efec-4f62-ac1c-80ac691c0ea0 HTTP/1.1" status: 200  len: 210 time: 0.0555003
Jun 02 16:43:16.059950 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa76751c-4500-4e7b-bfc4-fecdc5fe489b x-openstack-request-id: req-fa76751c-4500-4e7b-bfc4-fecdc5fe489b {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:16.060964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f86a1088-efec-4f62-ac1c-80ac691c0ea0", "name": "network-vif-deleted", "tag": "5e1e9de7-d161-410e-9e7e-a9f74a701739", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:16.061505 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-fa76751c-4500-4e7b-bfc4-fecdc5fe489b {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:16.062141 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f86a1088-efec-4f62-ac1c-80ac691c0ea0', 'name': 'network-vif-deleted', 'tag': '5e1e9de7-d161-410e-9e7e-a9f74a701739', 'status': 'completed', 'code': 200}
Jun 02 16:43:16.425710 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da42f12-a8f3-4ef2-907c-edafec3dc700 req-e83f714c-e56f-48fc-82c4-34831275b736 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:16.427194 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2da42f12-a8f3-4ef2-907c-edafec3dc700 req-e83f714c-e56f-48fc-82c4-34831275b736 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.2170770
Jun 02 16:43:16.482126 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2da42f12-a8f3-4ef2-907c-edafec3dc700 req-294b4d4d-73f5-4d02-87ab-4b37ee08daa6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0439193
Jun 02 16:43:16.519472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:16.609237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:16.902756 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:16.910786 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:16.916139 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-48bdc127-f656-4977-b0b2-0eb188f2a6d6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:16.976774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdda2d75-9500-499c-adbc-7edaaf3a91cf req-ecc917ec-b581-47f4-b9ef-1ac4385868d8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:16.978649 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fdda2d75-9500-499c-adbc-7edaaf3a91cf req-ecc917ec-b581-47f4-b9ef-1ac4385868d8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1628270
Jun 02 16:43:17.097268 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=e164cbec-6e1d-4818-9119-889c318d5178,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:17.107062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:17.107939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:17.174394 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fdda2d75-9500-499c-adbc-7edaaf3a91cf req-ba41c0ac-c92d-4af9-a1cc-df116578e255 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1614442
Jun 02 16:43:17.302841 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP 5cb68a72-e093-4e8d-af39-4044762ec487 associated. External IP: 172.27.0.114, port: 14762d04-cafa-47ea-9929-61cd3a540431.
Jun 02 16:43:17.612715 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faa008f-2a80-45f6-b952-c4180e556a5e req-29baf2d9-1dce-4c1d-a243-7bbc83b99dfa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:17.614237 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3faa008f-2a80-45f6-b952-c4180e556a5e req-29baf2d9-1dce-4c1d-a243-7bbc83b99dfa tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1771410
Jun 02 16:43:17.687752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eecdaa26-2561-4440-a531-224eef80ba74 req-d68206ae-0a3d-44b9-aa88-2ee67d3cd9c9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:17.689221 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eecdaa26-2561-4440-a531-224eef80ba74 req-d68206ae-0a3d-44b9-aa88-2ee67d3cd9c9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0797532
Jun 02 16:43:17.739512 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3faa008f-2a80-45f6-b952-c4180e556a5e req-7dbd5f38-de6e-4f2d-b860-6a7249a107d1 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1141939
Jun 02 16:43:17.741517 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eecdaa26-2561-4440-a531-224eef80ba74 req-5274a212-8c0f-4d1b-ab32-e8b68889cddf tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0460269
Jun 02 16:43:17.760933 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:43:17.922491 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device aa2c51f5-ce26-4924-b07d-2fd35ef89adb no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:17.939453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:43:17.951498 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:43:17.964837 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:43:17.965578 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f9d640>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:42:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:17.967795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:17.974627 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: aa2c51f5-ce26-4924-b07d-2fd35ef89adb {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:17.975091 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device aa2c51f5-ce26-4924-b07d-2fd35ef89adb not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:18.151694 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.0196624
Jun 02 16:43:18.152630 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:18.155696 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f" -d '{"events": [{"name": "network-changed", "server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "tag": "14762d04-cafa-47ea-9929-61cd3a540431"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:18.208603 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:43:18.263876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-338ca2fb-734f-421a-8005-21972558a358 x-openstack-request-id: req-338ca2fb-734f-421a-8005-21972558a358 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:18.264045 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "tag": "14762d04-cafa-47ea-9929-61cd3a540431", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:18.264208 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-338ca2fb-734f-421a-8005-21972558a358 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:18.264623 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431', 'status': 'completed', 'code': 200}
Jun 02 16:43:18.436981 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-6dcfa40e-6913-4de2-9972-95a764c157c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.438500 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-6dcfa40e-6913-4de2-9972-95a764c157c0 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 1098 time: 0.1436000
Jun 02 16:43:18.449426 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ad0b0ef-02ef-4b9c-8bc0-ebe700d6e0df req-ca185ba9-dc38-4bc7-aa11-e061fee71f79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.450107 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-3ad0b0ef-02ef-4b9c-8bc0-ebe700d6e0df req-ca185ba9-dc38-4bc7-aa11-e061fee71f79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Synchronizing usage tracker for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:43:18.543108 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-3ad0b0ef-02ef-4b9c-8bc0-ebe700d6e0df req-ca185ba9-dc38-4bc7-aa11-e061fee71f79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Unset dirty status for tenant:a3af7d82fba84269a3596d85213ae5e2 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:43:18.544175 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3ad0b0ef-02ef-4b9c-8bc0-ebe700d6e0df req-ca185ba9-dc38-4bc7-aa11-e061fee71f79 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.2101853
Jun 02 16:43:18.598646 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f9d640>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '5cb68a72-e093-4e8d-af39-4044762ec487', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.114', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '14762d04-cafa-47ea-9929-61cd3a540431', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:19:ed:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:43:16Z', 'updated_at': '2021-06-02T16:43:16Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:18.603210 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:43:18.614034 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:43:18.614641 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f9d640>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:42:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:18.615473 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-274fdf58-9113-4e6e-9c57-a00067bfb808 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.616916 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-274fdf58-9113-4e6e-9c57-a00067bfb808 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1639488
Jun 02 16:43:18.621551 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3ad0b0ef-02ef-4b9c-8bc0-ebe700d6e0df req-c3bfc4c6-3818-40b5-a67c-d4ae084948b8 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/security-groups?id=75bcef4b-f728-4233-ad34-9ba33c8ff51d&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0706697
Jun 02 16:43:18.726404 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-4cb0574f-a76d-4b77-a7b2-c33ea28bc9d9 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=14762d04-cafa-47ea-9929-61cd3a540431 HTTP/1.1" status: 200  len: 999 time: 0.1013584
Jun 02 16:43:18.791479 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:43:18.791813 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-9391a565-0448-4731-bd9b-cf7d6bee4f81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.793330 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-9391a565-0448-4731-bd9b-cf7d6bee4f81 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0575852
Jun 02 16:43:18.873770 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-0b3c1ebd-fe1d-49c3-ad32-1b4c578b8e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.875245 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-0b3c1ebd-fe1d-49c3-ad32-1b4c578b8e7c service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0746758
Jun 02 16:43:18.991840 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c33b608-e342-488a-9903-79059f975943 req-83be485c-3771-4ae9-840f-908a960075ce tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:18.993403 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6c33b608-e342-488a-9903-79059f975943 req-83be485c-3771-4ae9-840f-908a960075ce tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1365423
Jun 02 16:43:19.012422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-bad63296-7374-4654-809c-66e1ab8d9444 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:19.013968 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-bad63296-7374-4654-809c-66e1ab8d9444 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 945 time: 0.1068103
Jun 02 16:43:19.040235 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-fe43b968-7355-4970-bebe-22eb2fcca7fc service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1335342
Jun 02 16:43:19.103750 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6c33b608-e342-488a-9903-79059f975943 req-0b4fa6dd-b2ad-43c1-ae31-e0649a5c2d82 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0989902
Jun 02 16:43:19.153199 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f9d640>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '5cb68a72-e093-4e8d-af39-4044762ec487', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.114', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '14762d04-cafa-47ea-9929-61cd3a540431', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:19:ed:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:43:16Z', 'updated_at': '2021-06-02T16:43:16Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:19.157954 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41d32121-bcb9-4c3e-8b96-60bee58805ae None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '5cb68a72-e093-4e8d-af39-4044762ec487', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.114', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '14762d04-cafa-47ea-9929-61cd3a540431', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:19:ed:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:43:16Z', 'updated_at': '2021-06-02T16:43:16Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:43:19.180195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Deleting port 98e1f389-92e2-4b54-838c-4df675f8b9b3 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:19.180462 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ce118f29-d2fb-4dfe-91b5-faa3b00ba08f req-95b3146b-8619-4e63-8754-e5f26c8e61ce service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1304519
Jun 02 16:43:19.180566 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:19.339489 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] For port 98e1f389-92e2-4b54-838c-4df675f8b9b3, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=98e1f389-92e2-4b54-838c-4df675f8b9b3,segment=NetworkSegment(59c8b886-b320-4458-b689-37f87c2bd654),segment_id=59c8b886-b320-4458-b689-37f87c2bd654)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:19.339944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:19.455016 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e226a3-6b03-4b06-97c4-3a693e34cdd7 None None] New status for floating IP 5cb68a72-e093-4e8d-af39-4044762ec487: ACTIVE {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:43:19.471583 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Calling delete_port for 98e1f389-92e2-4b54-838c-4df675f8b9b3 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:19.586772 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:19.593878 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dcbc2c70-fc9a-4d1b-9e14-459f2db44437 tempest-VolumesActionsTest-639980747 tempest-VolumesActionsTest-639980747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:19.634792 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['98e1f389-92e2-4b54-838c-4df675f8b9b3'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:19.676442 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Pushing event deleted for resources: {'Port': ['ID=98e1f389-92e2-4b54-838c-4df675f8b9b3,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:19.683881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:19.726914 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] No DVR routers for this DVR port 98e1f389-92e2-4b54-838c-4df675f8b9b3 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:19.730089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:19.744737 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0f295ee7-50a8-4f0d-a809-c2d35483cfde req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.20 "DELETE /v2.0/ports/98e1f389-92e2-4b54-838c-4df675f8b9b3 HTTP/1.1" status: 204  len: 173 time: 0.7159753
Jun 02 16:43:19.796884 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-37e20808-77d5-4d0b-acf8-f3ada442e861 req-5abb610f-04b9-4b33-81e4-3f32202c2062 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] 10.222.0.25 "GET /v2.0/ports?device_id=63b64dda-5b51-44d1-8faf-b7d2d466c1b9 HTTP/1.1" status: 200  len: 210 time: 0.0564392
Jun 02 16:43:19.955451 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 5e1e9de7-d161-410e-9e7e-a9f74a701739 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:19.993032 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 5e1e9de7-d161-410e-9e7e-a9f74a701739 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:19.993376 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 5e1e9de7-d161-410e-9e7e-a9f74a701739 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:20.269331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'name': 'network-vif-deleted', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:20.271803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-daba25ab-ca60-441d-b8fd-aa4275ddffcc" -d '{"events": [{"server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "name": "network-vif-deleted", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:20.322863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de4f085-de52-40fd-9360-2c62aea17656 req-361292df-6ec3-4ac3-ad42-e9b57612cb5e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:20.324274 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8de4f085-de52-40fd-9360-2c62aea17656 req-361292df-6ec3-4ac3-ad42-e9b57612cb5e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1057777
Jun 02 16:43:20.325743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ceab6940-66a2-41d5-89c8-f30ed9aaaa52 x-openstack-request-id: req-ceab6940-66a2-41d5-89c8-f30ed9aaaa52 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:20.326080 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63b64dda-5b51-44d1-8faf-b7d2d466c1b9", "name": "network-vif-deleted", "tag": "98e1f389-92e2-4b54-838c-4df675f8b9b3", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:20.326393 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ceab6940-66a2-41d5-89c8-f30ed9aaaa52 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:20.326787 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63b64dda-5b51-44d1-8faf-b7d2d466c1b9', 'name': 'network-vif-deleted', 'tag': '98e1f389-92e2-4b54-838c-4df675f8b9b3', 'status': 'completed', 'code': 200}
Jun 02 16:43:20.373714 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8de4f085-de52-40fd-9360-2c62aea17656 req-3c2c182c-f159-4d0a-b3e1-6a6025a2991c tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431426
Jun 02 16:43:20.900121 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53442) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:20.959975 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Deleting subnet 409c7043-b3b6-42f7-90b5-f7db5d717e70 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:43:20.963290 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.109209 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.164273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.420289 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.425900 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-23365a1c-e4b1-4bfe-8545-ce054e12d76c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:21.461131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=409c7043-b3b6-42f7-90b5-f7db5d717e70,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:21.463078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.465768 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:21.470781 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/409c7043-b3b6-42f7-90b5-f7db5d717e70 HTTP/1.1" status: 204  len: 168 time: 0.5690196
Jun 02 16:43:21.472656 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53448) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:21.579978 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a981e7ea-8ad2-4d25-b242-ec5060da06f1 req-cd622ec1-1b86-498b-9f88-09b9b6b31a8b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:21.581830 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a981e7ea-8ad2-4d25-b242-ec5060da06f1 req-cd622ec1-1b86-498b-9f88-09b9b6b31a8b tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0903502
Jun 02 16:43:21.589432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.634179 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a981e7ea-8ad2-4d25-b242-ec5060da06f1 req-3f6d3db9-4fa9-4e28-a496-09e5fce1892a tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448692
Jun 02 16:43:21.718466 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.732147 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7aebb7c0>,) {'filters': {'network_id': ['87543dfa-9cef-40b2-b537-1f95fcf2b066']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:21.747420 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7aebb7c0>, '59c8b886-b320-4458-b689-37f87c2bd654') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:21.747717 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7aebb7c0>, '59c8b886-b320-4458-b689-37f87c2bd654') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:21.759684 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.775902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.782533 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Releasing vlan 679 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:43:21.782919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:43:21.799925 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:43:21.874509 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.878552 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:21.891827 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:21.902016 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Pushing event deleted for resources: {'Network': ['ID=87543dfa-9cef-40b2-b537-1f95fcf2b066,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:21.905287 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:21.911348 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] 10.222.0.25 "DELETE /v2.0/networks/87543dfa-9cef-40b2-b537-1f95fcf2b066 HTTP/1.1" status: 204  len: 168 time: 0.4376979
Jun 02 16:43:22.104715 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53456) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:22.159999 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9d0de581-33a7-4892-ac6a-adb9489d8da7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a3af7d82fba84269a3596d85213ae5e2&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0539305
Jun 02 16:43:22.162496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53458) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:22.221799 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:22.247600 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:22.304706 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:22.310813 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-55f9a354-dda5-4706-97dd-34aa370e7ffb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:22.327459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75bcef4b-f728-4233-ad34-9ba33c8ff51d,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:22.331442 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:22.335782 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:22.336920 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/75bcef4b-f728-4233-ad34-9ba33c8ff51d HTTP/1.1" status: 204  len: 168 time: 0.1735010
Jun 02 16:43:22.829573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e80e412-b1eb-4787-9627-8add1a64f5bc req-1fc0c957-85c7-42ce-8bdd-10c3bf92a70e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:22.830400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-1e80e412-b1eb-4787-9627-8add1a64f5bc req-1fc0c957-85c7-42ce-8bdd-10c3bf92a70e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Synchronizing usage tracker for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:43:22.846989 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-1e80e412-b1eb-4787-9627-8add1a64f5bc req-1fc0c957-85c7-42ce-8bdd-10c3bf92a70e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Unset dirty status for tenant:2a331932fba240f7a0fbb0b93203268c on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:43:22.848211 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1e80e412-b1eb-4787-9627-8add1a64f5bc req-1fc0c957-85c7-42ce-8bdd-10c3bf92a70e tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1034687
Jun 02 16:43:22.900993 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1e80e412-b1eb-4787-9627-8add1a64f5bc req-0dfc4160-fc33-4809-817c-9a34aae75725 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462525
Jun 02 16:43:23.558439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-dbf887ee-af1a-459d-918f-002a6dad41f7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:23.560011 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-dbf887ee-af1a-459d-918f-002a6dad41f7 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.0906916
Jun 02 16:43:23.701953 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Deleting port b28c3bf7-7098-48bc-8c31-211ba369c5bf {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:23.702514 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:23.870097 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] For port b28c3bf7-7098-48bc-8c31-211ba369c5bf, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=b28c3bf7-7098-48bc-8c31-211ba369c5bf,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:23.870455 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:23.962689 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 98e1f389-92e2-4b54-838c-4df675f8b9b3 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:24.000877 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 98e1f389-92e2-4b54-838c-4df675f8b9b3 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:24.001273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 98e1f389-92e2-4b54-838c-4df675f8b9b3 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:24.073961 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Calling delete_port for b28c3bf7-7098-48bc-8c31-211ba369c5bf owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:24.185193 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104f977a-dc50-4c91-b11b-0a27bc540f37 req-c8103e10-5209-4c3f-915c-4582d2a84801 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:24.186739 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-104f977a-dc50-4c91-b11b-0a27bc540f37 req-c8103e10-5209-4c3f-915c-4582d2a84801 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/ports?device_id=226e2fc4-ba3e-4aef-97fb-c53539c9eba6 HTTP/1.1" status: 200  len: 945 time: 0.1198802
Jun 02 16:43:24.290953 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-104f977a-dc50-4c91-b11b-0a27bc540f37 req-88622166-5ba6-4711-8fbe-4984e014c740 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.25 "GET /v2.0/security-groups?id=6ef97cdf-badb-4182-b404-c9d480fe5811&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0967467
Jun 02 16:43:24.296837 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:24.303629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8aa499f4-041b-4e5a-8651-6059ad341a21 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:24.309851 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['b28c3bf7-7098-48bc-8c31-211ba369c5bf'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:24.351998 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Pushing event deleted for resources: {'Port': ['ID=b28c3bf7-7098-48bc-8c31-211ba369c5bf,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:24.355307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:24.425421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] No DVR routers for this DVR port b28c3bf7-7098-48bc-8c31-211ba369c5bf on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:24.428803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:24.431515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'name': 'network-vif-deleted', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:24.433840 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5dc03710-2d0b-448d-a947-98f9b86d02a3" -d '{"events": [{"server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "name": "network-vif-deleted", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:24.448941 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6d856b5a-aaa3-40ef-9f24-a02df4b4aba0 req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] 10.222.0.20 "DELETE /v2.0/ports/b28c3bf7-7098-48bc-8c31-211ba369c5bf HTTP/1.1" status: 204  len: 173 time: 0.8831236
Jun 02 16:43:24.477001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5c7370f-418d-4f81-b23e-4024d579c4d4 x-openstack-request-id: req-b5c7370f-418d-4f81-b23e-4024d579c4d4 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:24.477316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "226e2fc4-ba3e-4aef-97fb-c53539c9eba6", "name": "network-vif-deleted", "tag": "b28c3bf7-7098-48bc-8c31-211ba369c5bf", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:24.478004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b5c7370f-418d-4f81-b23e-4024d579c4d4 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:24.478409 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '226e2fc4-ba3e-4aef-97fb-c53539c9eba6', 'name': 'network-vif-deleted', 'tag': 'b28c3bf7-7098-48bc-8c31-211ba369c5bf', 'status': 'completed', 'code': 200}
Jun 02 16:43:25.388687 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53526) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:25.793108 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4eedefe0-d31a-425d-ac75-dc7ed75728da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:25.945564 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:26.463984 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Deleting port 5e024a6b-65b5-4078-af70-6779bd688836 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:26.464732 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:26.597536 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] For port 5e024a6b-65b5-4078-af70-6779bd688836, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5e024a6b-65b5-4078-af70-6779bd688836,segment=NetworkSegment(27a32301-de09-4cde-a3f0-526d03f25ea3),segment_id=27a32301-de09-4cde-a3f0-526d03f25ea3)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:26.597907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:26.730851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Calling delete_port for 5e024a6b-65b5-4078-af70-6779bd688836 owned by network:router_interface {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:27.026097 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:27.030577 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:27.074983 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Pushing event deleted for resources: {'Port': ['ID=5e024a6b-65b5-4078-af70-6779bd688836,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:27.078288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:27.350865 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:27.821783 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Router aaae5f75-b61b-4f4d-8d83-298cf66986f0 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:43:28.007301 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:43:28.016110 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Sync routers for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:43:28.021776 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] 10.222.0.25 "PUT /v2.0/routers/aaae5f75-b61b-4f4d-8d83-298cf66986f0/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6318355
Jun 02 16:43:28.024447 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53550) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:28.030028 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:43:28.031029 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c127880>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:42:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:28.210392 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.215409 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:43:28.326990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device b28c3bf7-7098-48bc-8c31-211ba369c5bf no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:28.374791 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: b28c3bf7-7098-48bc-8c31-211ba369c5bf {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:28.375146 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device b28c3bf7-7098-48bc-8c31-211ba369c5bf not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:28.418016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.481360 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1a14df4d-6b1b-4d0d-9a88-fe1b91cbe0ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.497366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Deleting port b982aaa4-941e-42c4-b4ad-f81777aafbd9 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:28.497768 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.546281 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c127880>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50'}], 'enable_snat': True}, 'gw_port_id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:43:26Z', 'revision_number': 5, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port': {'id': 'b982aaa4-941e-42c4-b4ad-f81777aafbd9', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:33:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:42Z', 'updated_at': '2021-06-02T16:39:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:28.550187 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Checking router: aaae5f75-b61b-4f4d-8d83-298cf66986f0 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:43:28.558289 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Routers {'aaae5f75-b61b-4f4d-8d83-298cf66986f0'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:43:28.558872 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c127880>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:43:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:28.626941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] For port b982aaa4-941e-42c4-b4ad-f81777aafbd9, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=b982aaa4-941e-42c4-b4ad-f81777aafbd9,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:28.627204 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.732712 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] Set router aaae5f75-b61b-4f4d-8d83-298cf66986f0 gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:43:28.746309 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:28.752099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Calling delete_port for b982aaa4-941e-42c4-b4ad-f81777aafbd9 owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:28.833878 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c127880>, [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:43:28Z', 'revision_number': 6, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:28.837931 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b6f485-87fe-48f5-9206-19221f798ae8 None None] The sync data for ids ['aaae5f75-b61b-4f4d-8d83-298cf66986f0'] in dv-cinder-794021-2-iscsi is: [{'id': 'aaae5f75-b61b-4f4d-8d83-298cf66986f0', 'name': 'tempest-ServerRescueNegativeTestJSON-851761837-router', 'tenant_id': '2a331932fba240f7a0fbb0b93203268c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:40Z', 'updated_at': '2021-06-02T16:43:28Z', 'revision_number': 6, 'project_id': '2a331932fba240f7a0fbb0b93203268c', 'gw_port_host': None}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:43:29.036359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.041540 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:29.184945 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Pushing event deleted for resources: {'Port': ['ID=b982aaa4-941e-42c4-b4ad-f81777aafbd9,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:29.187496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:29.287009 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.466896 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.469201 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.552422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.553146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Fanout notify agent at l3_agent the message router_deleted on router aaae5f75-b61b-4f4d-8d83-298cf66986f0 {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:43:29.566703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.567769 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] 10.222.0.25 "DELETE /v2.0/routers/aaae5f75-b61b-4f4d-8d83-298cf66986f0 HTTP/1.1" status: 204  len: 168 time: 1.5422447
Jun 02 16:43:29.570297 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53570) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:29.633812 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Deleting subnet 0181ac68-65a5-4b9a-9995-215bf77b5c32 {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:43:29.637117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.688631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:29.755859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.019164 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.023216 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:30.059925 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0181ac68-65a5-4b9a-9995-215bf77b5c32,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:30.063532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:30.064480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.070406 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a3f1ff3f-26a5-4e80-bf8c-833adaccad71 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/0181ac68-65a5-4b9a-9995-215bf77b5c32 HTTP/1.1" status: 204  len: 168 time: 0.4992001
Jun 02 16:43:30.072834 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53572) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:30.189805 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.190398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.327997 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.341003 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b76a83c10>,) {'filters': {'network_id': ['1f2f7c0d-7d36-4292-bab6-39e7de3c95ef']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:30.354378 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b76a83c10>, '27a32301-de09-4cde-a3f0-526d03f25ea3') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:30.354695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b76a83c10>, '27a32301-de09-4cde-a3f0-526d03f25ea3') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:43:30.366140 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.374680 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b982aaa4-941e-42c4-b4ad-f81777aafbd9 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:30.382536 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.389269 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Releasing vlan 682 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:43:30.389722 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:43:30.409144 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:43:30.412662 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: b982aaa4-941e-42c4-b4ad-f81777aafbd9 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:30.413018 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device b982aaa4-941e-42c4-b4ad-f81777aafbd9 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:30.413443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5e024a6b-65b5-4078-af70-6779bd688836 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:30.455013 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 5e024a6b-65b5-4078-af70-6779bd688836 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:30.455369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5e024a6b-65b5-4078-af70-6779bd688836 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:30.485808 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.490184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0ee60e49-170b-4d2e-b944-79815052b715 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:30.506537 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.513067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Pushing event deleted for resources: {'Network': ['ID=1f2f7c0d-7d36-4292-bab6-39e7de3c95ef,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:30.521987 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:30.525712 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ca0f528e-01e6-4ede-a088-57c8bffdb8e3 admin admin] 10.222.0.25 "DELETE /v2.0/networks/1f2f7c0d-7d36-4292-bab6-39e7de3c95ef HTTP/1.1" status: 204  len: 168 time: 0.4519360
Jun 02 16:43:30.702613 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53590) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:30.754523 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-30d71d6a-d00b-457c-842e-7070c2dd458a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2a331932fba240f7a0fbb0b93203268c&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0507073
Jun 02 16:43:30.757059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53594) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:30.815359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.842712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.904308 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.913582 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a8de8d0a-0f98-415b-ae72-986241ee7d9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:30.936487 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ef97cdf-badb-4182-b404-c9d480fe5811,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:30.941070 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:30.959420 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:30.973021 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6ef97cdf-badb-4182-b404-c9d480fe5811 HTTP/1.1" status: 204  len: 168 time: 0.2034216
Jun 02 16:43:31.841292 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.296023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53654) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:32.430165 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.446196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:32.450234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Usage tracker for resource:security_group_rule and tenant:489c0fadc7ce4482848a8ffb90bc79c9 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:32.453312 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:32.459310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:32.550368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.558474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.567484 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e90c91a5-2185-43dd-967f-a327c3d40a0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:32.608954 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d62bed31-218f-4122-a577-be9c8050aa14,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:32.624396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53670) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:32.624883 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=489c0fadc7ce4482848a8ffb90bc79c9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3273082
Jun 02 16:43:32.626004 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50ffc80f-a09c-4d43-866d-b4e7956fc3b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:32.809859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.839219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.921619 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.927445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-956c6cf8-3421-4c21-979c-aa5bf8ec1238 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:32.938823 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d62bed31-218f-4122-a577-be9c8050aa14,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:32.945820 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:32.946690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:32.948115 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d62bed31-218f-4122-a577-be9c8050aa14 HTTP/1.1" status: 204  len: 168 time: 0.3226290
Jun 02 16:43:33.551708 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53710) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:33.757578 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:33.806879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:33.823160 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:33.827445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Usage tracker for resource:security_group_rule and tenant:02025d82ccfe47a5b66dc6e2cfaf9d40 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:33.830482 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:33.837734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:33.964337 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:33.969550 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:33.979232 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-194b2144-1cab-45eb-9e20-4f6a53df8e06 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:34.025380 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=02025d82ccfe47a5b66dc6e2cfaf9d40&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4721787
Jun 02 16:43:34.035406 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53734) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:34.038648 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42c947ac-3273-41e3-9f34-5c79aa1ebc60,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:34.044072 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:34.095154 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.132965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.193996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.199205 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f0bb983f-b534-4f27-98c1-4d6dca796068 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:34.210330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42c947ac-3273-41e3-9f34-5c79aa1ebc60,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:34.212655 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:34.218575 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.220386 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/42c947ac-3273-41e3-9f34-5c79aa1ebc60 HTTP/1.1" status: 204  len: 168 time: 0.1917391
Jun 02 16:43:34.648422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53754) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:34.667347 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.683328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:34.688278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Usage tracker for resource:security_group_rule and tenant:bdbb04f736a544db902f27a7c1c33404 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:34.691457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:34.697497 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:34.812176 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.818881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.829159 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-82724cd2-aabc-4f0b-8bd0-64a3b5ed5b36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:34.873136 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=bdbb04f736a544db902f27a7c1c33404&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2229941
Jun 02 16:43:34.873926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=479a6a93-7a0b-4a44-8f1e-83a70520bf77,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:34.876657 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53762) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:34.877307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-189989b9-7717-49c6-b405-bc33d2841b6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:34.941822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:34.978355 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:35.038755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:35.042691 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-de7767bf-cdf6-444b-86ec-9b039b0d2d7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:35.061418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=479a6a93-7a0b-4a44-8f1e-83a70520bf77,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:35.068273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:35.083025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:35.087617 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/479a6a93-7a0b-4a44-8f1e-83a70520bf77 HTTP/1.1" status: 204  len: 168 time: 0.2059391
Jun 02 16:43:36.697486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53832) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:36.827815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:36.843939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:36.848191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Usage tracker for resource:security_group_rule and tenant:0d79577067914b0eb1ea570e9678bfdf is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:36.851161 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:36.858483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:36.959765 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:36.965510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:36.992307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-70613de0-9d4b-4473-b5fd-6ac3f9998b1a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:37.009126 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0d79577067914b0eb1ea570e9678bfdf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3104770
Jun 02 16:43:37.009413 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53844) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:37.028195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d3c1e02-e4b4-4390-a1f7-803cb2183711,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:37.035140 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:37.093405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.123338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.198121 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.203730 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8cf336f4-576f-4e25-aa53-188c8bc40310 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:37.215083 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d3c1e02-e4b4-4390-a1f7-803cb2183711,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:37.217818 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:37.223941 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.227940 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3d3c1e02-e4b4-4390-a1f7-803cb2183711 HTTP/1.1" status: 204  len: 168 time: 0.2133780
Jun 02 16:43:37.416708 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53858) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:37.607517 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.622490 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:37.626501 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Usage tracker for resource:security_group_rule and tenant:2d725dffc813449687b97892adc0cef2 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:37.629335 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:37.635398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:37.731785 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.738935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.746297 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9412c108-d207-4bc8-8f0a-fee7de791181 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:37.786990 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2d725dffc813449687b97892adc0cef2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3690305
Jun 02 16:43:37.787911 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77efa250-e30a-4684-954b-1cae044a1bcd,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:37.789876 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53862) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:37.791049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:37.854811 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.882905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.935922 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.939672 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-533f281e-8b54-40c1-960a-b3a9f544796d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:37.952760 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77efa250-e30a-4684-954b-1cae044a1bcd,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:37.955713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:37.957713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:37.961204 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/77efa250-e30a-4684-954b-1cae044a1bcd HTTP/1.1" status: 204  len: 168 time: 0.1679423
Jun 02 16:43:38.315362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 53878) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:38.335279 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.351511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:38.356237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Usage tracker for resource:security_group_rule and tenant:afad6e7a07204c59a6d9433cde47e598 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:38.359809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:38.366219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:38.467751 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.473571 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.483343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6b663992-5338-44e9-8ddb-f52edbe569ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:38.526622 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=afad6e7a07204c59a6d9433cde47e598&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2101560
Jun 02 16:43:38.526622 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13a8fbd0-6d41-4227-b459-c53257395bd2,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:38.527143 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 53882) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:38.528490 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:38.592841 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.635296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.696105 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.700641 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2bb1594f-5db5-4c00-b231-eb9bec858fe3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:38.716108 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13a8fbd0-6d41-4227-b459-c53257395bd2,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:38.721227 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:38.723268 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:38.728264 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/13a8fbd0-6d41-4227-b459-c53257395bd2 HTTP/1.1" status: 204  len: 168 time: 0.1999691
Jun 02 16:43:38.852267 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0926fcf4-4677-4d77-a14c-1b94d31f7be3 req-5e97059b-827d-4e4b-9773-6a43c4d99028 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:38.854436 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0926fcf4-4677-4d77-a14c-1b94d31f7be3 req-5e97059b-827d-4e4b-9773-6a43c4d99028 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0919776
Jun 02 16:43:38.905510 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0926fcf4-4677-4d77-a14c-1b94d31f7be3 req-7a252488-2050-4e3b-be98-1e39bede24d4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427213
Jun 02 16:43:40.115502 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa714fc7-bdfc-432c-9913-ff09a7522c2b req-cfeaddd2-1d68-46fe-a2bb-97cb669567ac tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:40.117052 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fa714fc7-bdfc-432c-9913-ff09a7522c2b req-cfeaddd2-1d68-46fe-a2bb-97cb669567ac tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0935009
Jun 02 16:43:40.163532 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fa714fc7-bdfc-432c-9913-ff09a7522c2b req-4b752224-260a-4f42-8c09-045c9f719c04 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406086
Jun 02 16:43:41.366283 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a8866e-a393-4af7-9e30-cfc626958216 req-a3bddfd7-e76d-41d3-ad3b-68cc18045b60 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:41.367936 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35a8866e-a393-4af7-9e30-cfc626958216 req-a3bddfd7-e76d-41d3-ad3b-68cc18045b60 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0924702
Jun 02 16:43:41.415984 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-35a8866e-a393-4af7-9e30-cfc626958216 req-433777aa-99b0-4e2c-b2b8-6807a2c04c81 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420809
Jun 02 16:43:42.632793 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c392d410-7376-4cce-a1ac-cd607182a2ab req-13b1d3c1-38da-4e03-b72f-420227c8480e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:42.634970 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c392d410-7376-4cce-a1ac-cd607182a2ab req-13b1d3c1-38da-4e03-b72f-420227c8480e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0967658
Jun 02 16:43:42.684929 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c392d410-7376-4cce-a1ac-cd607182a2ab req-f650348d-79fa-49d7-9e2e-a78fc28f9380 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434155
Jun 02 16:43:43.171808 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc870eeb-aee3-4036-b987-f16e6202f9bd req-0b817ad3-0d14-419e-87d7-a4ef371be705 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:43.173479 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cc870eeb-aee3-4036-b987-f16e6202f9bd req-0b817ad3-0d14-419e-87d7-a4ef371be705 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 945 time: 0.1218493
Jun 02 16:43:43.231603 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cc870eeb-aee3-4036-b987-f16e6202f9bd req-f956c513-9199-4d17-bd46-e351074aebb8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476248
Jun 02 16:43:43.894120 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79dbe91-a8ad-4f09-a8e3-41ee73bee878 req-82eccf55-90f5-4cad-af86-ddf32d6c3c0d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:43.895527 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f79dbe91-a8ad-4f09-a8e3-41ee73bee878 req-82eccf55-90f5-4cad-af86-ddf32d6c3c0d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0956976
Jun 02 16:43:43.946687 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f79dbe91-a8ad-4f09-a8e3-41ee73bee878 req-bf759dd1-186b-4d7e-9d78-8297e19a4150 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430071
Jun 02 16:43:44.442556 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b322b6f-741d-4ffa-8dd5-a2c2e719376b req-f75ec4d7-3dd5-47de-afcb-019682829fb3 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:44.444074 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8b322b6f-741d-4ffa-8dd5-a2c2e719376b req-f75ec4d7-3dd5-47de-afcb-019682829fb3 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 945 time: 0.1035311
Jun 02 16:43:44.490893 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8b322b6f-741d-4ffa-8dd5-a2c2e719376b req-f8565a04-86ed-4215-ac69-475d45af0a37 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406291
Jun 02 16:43:44.921363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-d2cfbf97-2fd1-4888-8b83-26eef30de9f5 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:44.922909 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-d2cfbf97-2fd1-4888-8b83-26eef30de9f5 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 945 time: 0.0825922
Jun 02 16:43:44.977214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54022) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:45.082604 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Deleting port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:43:45.082947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.116863 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.131685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:45.135587 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Usage tracker for resource:security_group_rule and tenant:2874db7a40394cfd9a888e69d633f532 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:45.138590 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:45.146934 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:45.240942 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.245356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.254039 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-075d59c2-084b-44a7-8cc9-2326fc187dcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:45.277569 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] For port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:43:45.277943 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.293538 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2874db7a40394cfd9a888e69d633f532&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3148425
Jun 02 16:43:45.294928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb69f5f8-bf40-424b-9794-730bed7e1008,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:45.297527 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54028) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:45.305528 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63fe9414-72ee-44ee-a829-bbc209cfdb41 req-713584e4-38d4-427b-ba15-ece869f79590 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:45.307051 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63fe9414-72ee-44ee-a829-bbc209cfdb41 req-713584e4-38d4-427b-ba15-ece869f79590 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.2081697
Jun 02 16:43:45.320069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.320443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.320811 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.321165 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.321515 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.321895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.322256 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.322589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.322936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.323279 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.323619 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.323959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:43:45.329205 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:45.436586 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Calling delete_port for 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:43:45.476958 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63fe9414-72ee-44ee-a829-bbc209cfdb41 req-a109cf0d-c0ba-484f-b9c9-84b9af1ae90d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1186662
Jun 02 16:43:45.479661 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.507733 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.566476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.571833 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a145848d-afce-4e8f-80fb-99c1e9485e87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:45.575718 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.582032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:45.584959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb69f5f8-bf40-424b-9794-730bed7e1008,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:45.588310 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['16e13b85-2dae-4b3b-bafe-16b18eaa4b57'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:43:45.599348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:45.600372 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.606046 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fb69f5f8-bf40-424b-9794-730bed7e1008 HTTP/1.1" status: 204  len: 168 time: 0.3079927
Jun 02 16:43:45.675092 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f51fb043-3670-46a2-a3a3-16aa809c2902 req-c5fbd607-c3a3-4551-8dc1-7eb55df4d0a8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=191e9c08-2f00-4ece-87f1-70c1b62dac73 HTTP/1.1" status: 200  len: 210 time: 0.0521097
Jun 02 16:43:45.724491 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Pushing event deleted for resources: {'Port': ['ID=16e13b85-2dae-4b3b-bafe-16b18eaa4b57,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:45.728292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:45.811983 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] No DVR routers for this DVR port 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:43:45.812869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:45.816404 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'name': 'network-vif-deleted', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:43:45.818778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fef8afca-f32b-4c43-8218-dcb1f77a0bb2" -d '{"events": [{"server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "name": "network-vif-deleted", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:43:45.861134 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f366e844-a131-4cdd-bee3-a7284c9d41c8 req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "DELETE /v2.0/ports/16e13b85-2dae-4b3b-bafe-16b18eaa4b57 HTTP/1.1" status: 204  len: 173 time: 0.9272890
Jun 02 16:43:45.875799 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:43:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68f83e6a-da94-4ee5-ab7a-893dc64d5689 x-openstack-request-id: req-68f83e6a-da94-4ee5-ab7a-893dc64d5689 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:43:45.876357 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "191e9c08-2f00-4ece-87f1-70c1b62dac73", "name": "network-vif-deleted", "tag": "16e13b85-2dae-4b3b-bafe-16b18eaa4b57", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:43:45.876640 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-68f83e6a-da94-4ee5-ab7a-893dc64d5689 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:43:45.877108 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '191e9c08-2f00-4ece-87f1-70c1b62dac73', 'name': 'network-vif-deleted', 'tag': '16e13b85-2dae-4b3b-bafe-16b18eaa4b57', 'status': 'completed', 'code': 200}
Jun 02 16:43:46.674678 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c51440d9-f537-4df2-98e3-644d3b9940de req-ae8b08cf-0773-4729-87f2-3ce9daea22cf tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:46.676155 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c51440d9-f537-4df2-98e3-644d3b9940de req-ae8b08cf-0773-4729-87f2-3ce9daea22cf tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0838974
Jun 02 16:43:46.723316 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c51440d9-f537-4df2-98e3-644d3b9940de req-c6553352-fbe5-436a-a1b7-372e6925d81e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411794
Jun 02 16:43:46.809756 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 54082) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:46.941032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:46.956814 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:46.960596 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Usage tracker for resource:security_group_rule and tenant:c59ad75296754202bc6f9113df31c92a is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:43:46.963696 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:43:46.969695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:47.078125 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.081777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.088603 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3ee2baa6-6725-4c78-9e93-eaafb335c31a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:47.132899 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c59ad75296754202bc6f9113df31c92a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3220048
Jun 02 16:43:47.133794 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1b780d7-7ad0-4235-aa1c-8a62ea2955c9,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:47.135617 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54088) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:43:47.136960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:47.213578 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.251254 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.311210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.315273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7abd4f44-99db-472c-b45e-33ff514356ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:43:47.326896 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1b780d7-7ad0-4235-aa1c-8a62ea2955c9,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:43:47.330469 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:43:47.334024 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:47.337476 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c1b780d7-7ad0-4235-aa1c-8a62ea2955c9 HTTP/1.1" status: 204  len: 168 time: 0.1985409
Jun 02 16:43:47.922376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e519f0-6431-4103-8360-c8b84b6a4c3b req-99adbf28-56de-40f6-a5d1-d3f5e944216a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:47.923854 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f4e519f0-6431-4103-8360-c8b84b6a4c3b req-99adbf28-56de-40f6-a5d1-d3f5e944216a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0862756
Jun 02 16:43:47.968986 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f4e519f0-6431-4103-8360-c8b84b6a4c3b req-ee935088-aa6e-491f-9f32-5475e3d08051 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394497
Jun 02 16:43:49.092263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:43:49.126391 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:43:49.126742 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 16e13b85-2dae-4b3b-bafe-16b18eaa4b57 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:43:49.170924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a5d4a3-9e02-4fb8-80cc-a400333eaa22 req-25021af8-2f3b-4c07-b82f-2a8bb96d4cf0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:49.172387 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50a5d4a3-9e02-4fb8-80cc-a400333eaa22 req-25021af8-2f3b-4c07-b82f-2a8bb96d4cf0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0933709
Jun 02 16:43:49.218349 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50a5d4a3-9e02-4fb8-80cc-a400333eaa22 req-64df3edd-1488-483b-bb8f-661886a6786a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401142
Jun 02 16:43:50.430649 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbd7f2f-e91b-4bb5-a693-318a90cdf6ef req-5e0bbe5c-8ca5-4f61-a7b4-b4415c2cedee tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:50.432233 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1fbd7f2f-e91b-4bb5-a693-318a90cdf6ef req-5e0bbe5c-8ca5-4f61-a7b4-b4415c2cedee tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0956092
Jun 02 16:43:50.479114 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1fbd7f2f-e91b-4bb5-a693-318a90cdf6ef req-133a4541-c431-4da1-8434-78cbf6530247 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410099
Jun 02 16:43:50.555990 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:43:51.670966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64c673b-c2a1-469b-97cf-4ef521883e12 req-29c4c6b2-9a78-4cc8-9c02-8d4661b2b0c6 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:51.672629 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e64c673b-c2a1-469b-97cf-4ef521883e12 req-29c4c6b2-9a78-4cc8-9c02-8d4661b2b0c6 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0810568
Jun 02 16:43:51.720857 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e64c673b-c2a1-469b-97cf-4ef521883e12 req-71227c6e-8325-4dd1-8e6f-0a7cd055c896 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404403
Jun 02 16:43:52.930037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12c1466-ca4f-4304-9e72-9ba3c8f60ba0 req-8b211400-2762-4b50-8267-c6aff7e7d3ca tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:52.932878 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c12c1466-ca4f-4304-9e72-9ba3c8f60ba0 req-8b211400-2762-4b50-8267-c6aff7e7d3ca tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0975876
Jun 02 16:43:52.991186 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c12c1466-ca4f-4304-9e72-9ba3c8f60ba0 req-4bce97fc-23a0-46e2-a2e5-cb7bc6823efb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0502591
Jun 02 16:43:54.189185 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd73f4b-8943-44a5-a76f-737c8c725797 req-d0e0f2b7-aee8-468a-8c08-7b6f69c5c571 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:54.190999 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3fd73f4b-8943-44a5-a76f-737c8c725797 req-d0e0f2b7-aee8-468a-8c08-7b6f69c5c571 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0893846
Jun 02 16:43:54.250288 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3fd73f4b-8943-44a5-a76f-737c8c725797 req-d45f9d6d-fcaf-4990-b915-cc835fbc87b4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535798
Jun 02 16:43:55.481368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30bf1a08-f641-4ef7-99b7-791a2b09078d req-ad2fc482-b8cd-4de5-bbd4-64abdd2055ea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:55.484321 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-30bf1a08-f641-4ef7-99b7-791a2b09078d req-ad2fc482-b8cd-4de5-bbd4-64abdd2055ea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1057496
Jun 02 16:43:55.537361 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-30bf1a08-f641-4ef7-99b7-791a2b09078d req-600757ca-a337-4e9a-a2b8-f789d0536980 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0472229
Jun 02 16:43:55.799958 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-23eb873c-02d1-47a4-a3c8-6c053544a582 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:56.739309 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335afa1c-f861-49db-b48e-83897e0cb664 req-ced48e9a-f919-44a4-951e-a65364ecfff5 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:56.740914 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-335afa1c-f861-49db-b48e-83897e0cb664 req-ced48e9a-f919-44a4-951e-a65364ecfff5 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0873935
Jun 02 16:43:56.798181 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-335afa1c-f861-49db-b48e-83897e0cb664 req-ab1af37d-b23f-4aab-b02c-27be501054dc tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495360
Jun 02 16:43:57.646799 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6bea488d-fedd-4c0c-96de-dc1fe4020305 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:57.647408 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6bea488d-fedd-4c0c-96de-dc1fe4020305 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Synchronizing usage tracker for tenant:72708e56387e47539c517fd7fe956ea3 on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:43:57.668546 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6bea488d-fedd-4c0c-96de-dc1fe4020305 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Unset dirty status for tenant:72708e56387e47539c517fd7fe956ea3 on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:43:57.670788 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6bea488d-fedd-4c0c-96de-dc1fe4020305 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 814 time: 0.1690190
Jun 02 16:43:57.693312 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-71dbeacb-b408-4666-849d-595910f5826a tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/quotas/72708e56387e47539c517fd7fe956ea3 HTTP/1.1" status: 200  len: 375 time: 0.0141864
Jun 02 16:43:57.744000 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-57310cfd-e294-45b3-b0b0-c30d6da9d26e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0428562
Jun 02 16:43:57.878621 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-1f71ef2d-bb33-4259-8e40-32c7064f4e06 service neutron] 10.222.0.25 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1271412
Jun 02 16:43:57.990772 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37462210-e6ff-4239-a1e6-65bcd63b4ee6 req-39dc39f9-b1b5-4a30-a18a-ba040c393acd tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:57.997858 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-37462210-e6ff-4239-a1e6-65bcd63b4ee6 req-39dc39f9-b1b5-4a30-a18a-ba040c393acd tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0877950
Jun 02 16:43:58.016056 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-fc9d7c4d-c56d-42ca-a341-09cda108bc6b service neutron] 10.222.0.25 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281338
Jun 02 16:43:58.054854 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-37462210-e6ff-4239-a1e6-65bcd63b4ee6 req-3dbd573a-ce52-4773-b917-7c0c4bb155d4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0552685
Jun 02 16:43:58.276493 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-13c468e2-6c80-48b0-b859-e2534118bfaa req-bc4bf9bd-529a-4708-8e3e-8add810c5fa0 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Synchronizing usage tracker for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:43:58.302797 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-13c468e2-6c80-48b0-b859-e2534118bfaa req-bc4bf9bd-529a-4708-8e3e-8add810c5fa0 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Unset dirty status for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:43:58.305131 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-13c468e2-6c80-48b0-b859-e2534118bfaa req-bc4bf9bd-529a-4708-8e3e-8add810c5fa0 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 210 time: 0.1074901
Jun 02 16:43:58.479639 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b23e3e38-efbb-45d4-9437-fa0616b3fab3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:58.742846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:59.271978 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505ccf3e-1dda-4a6e-a0be-7ee3812baf75 req-c9d2379d-3e30-4d35-b26e-22d40d4c538b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:59.274621 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-505ccf3e-1dda-4a6e-a0be-7ee3812baf75 req-c9d2379d-3e30-4d35-b26e-22d40d4c538b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1049390
Jun 02 16:43:59.330665 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-505ccf3e-1dda-4a6e-a0be-7ee3812baf75 req-d1cbb078-9233-48a5-8c95-8a1e555d212c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0492153
Jun 02 16:43:59.440308 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-8f7deace-3ce3-489e-a72c-8903feeed20b tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:43:59.441927 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-8f7deace-3ce3-489e-a72c-8903feeed20b tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 814 time: 0.2213788
Jun 02 16:43:59.481182 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Request body: {'port': {'device_id': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'network_id': '87782ba6-7481-4054-b9f8-31430743d283', 'admin_state_up': True, 'tenant_id': '72708e56387e47539c517fd7fe956ea3'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:43:59.512049 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5836911c-3d27-43a9-b1d4-53f03afaa701 req-e9195de5-5273-4c81-b8f9-76c0423a777d tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 210 time: 0.0690279
Jun 02 16:43:59.654872 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:43:59.664645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:43:59.676108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Made reservation on behalf of 72708e56387e47539c517fd7fe956ea3 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:43:59.680101 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:43:59.871833 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Allocated IP 172.20.0.14 (87782ba6-7481-4054-b9f8-31430743d283/5c2a516d-6355-4d25-a0bf-a043ecc26f20/af609d58-c97a-46bc-8c3b-93cc24aa231a) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:44:00.101134 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:00.134600 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:00.143732 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b1f51bbf-d941-4b6b-9f18-1a9039374626 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:00.191660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:00.219277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Network 87782ba6-7481-4054-b9f8-31430743d283 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:44:00.223017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:44:00.225738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:44:00.272421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Pushing event updated for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:00.289636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.289983 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.290331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.290672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.291008 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.291350 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.291682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.292032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.292347 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.292674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.292984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.293314 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:00.298882 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:00.310241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:00.310929 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:00.343814 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8674462
Jun 02 16:44:00.358821 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Request body: {'port': {'device_id': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:00.564101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80ff0fa-aa12-4076-8556-56d20701a9c2 req-7f91e6e8-f66c-4d4d-9426-5f9edf7e700d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:00.567070 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d80ff0fa-aa12-4076-8556-56d20701a9c2 req-7f91e6e8-f66c-4d4d-9426-5f9edf7e700d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0915043
Jun 02 16:44:00.591354 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:00.652473 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d80ff0fa-aa12-4076-8556-56d20701a9c2 req-ba091b78-32e4-41c3-a9cd-2ec78f3cf614 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0783978
Jun 02 16:44:00.889166 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcde29fd-40a8-4ef4-bf94-6ec5dfd99a67 req-2c3e4a5a-af65-4049-a4ff-4d8c4b3089ad tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:00.889766 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-bcde29fd-40a8-4ef4-bf94-6ec5dfd99a67 req-2c3e4a5a-af65-4049-a4ff-4d8c4b3089ad tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Synchronizing usage tracker for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:00.963866 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-bcde29fd-40a8-4ef4-bf94-6ec5dfd99a67 req-2c3e4a5a-af65-4049-a4ff-4d8c4b3089ad tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Unset dirty status for tenant:72708e56387e47539c517fd7fe956ea3 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:00.965017 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bcde29fd-40a8-4ef4-bf94-6ec5dfd99a67 req-2c3e4a5a-af65-4049-a4ff-4d8c4b3089ad tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 932 time: 0.3152239
Jun 02 16:44:00.988646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54422) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:01.038890 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bcde29fd-40a8-4ef4-bf94-6ec5dfd99a67 req-3e66078a-d8ed-4aba-a5ea-faaccb9c473e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0670021
Jun 02 16:44:01.119512 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.123830 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id af609d58-c97a-46bc-8c3b-93cc24aa231a {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:44:01.134110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.137040 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:01.141222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Usage tracker for resource:security_group_rule and tenant:36267c21831644108a9f0016c9f01e7f is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:01.144391 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:01.151749 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:01.156089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Transition to ACTIVE for port object af609d58-c97a-46bc-8c3b-93cc24aa231a will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:44:01.160546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.168801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:01.242303 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Pushing event updated for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:01.283283 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.288600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.293176 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:01.298189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-04fd5c98-7916-4663-9ecd-f35f1d65ed70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:01.327795 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a02d47c-2343-4606-93ff-fe409a8b1efa,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:01.331320 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:01.350121 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=36267c21831644108a9f0016c9f01e7f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3603916
Jun 02 16:44:01.352956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54430) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:01.411637 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Attempting to bind port af609d58-c97a-46bc-8c3b-93cc24aa231a on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:44:01.412108 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Attempting to bind port af609d58-c97a-46bc-8c3b-93cc24aa231a by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:44:01.412439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Attempting to bind port af609d58-c97a-46bc-8c3b-93cc24aa231a on network 87782ba6-7481-4054-b9f8-31430743d283 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:44:01.415412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.417264 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Port af609d58-c97a-46bc-8c3b-93cc24aa231a on network 87782ba6-7481-4054-b9f8-31430743d283 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:44:01.417676 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Attempting to bind port af609d58-c97a-46bc-8c3b-93cc24aa231a on network 87782ba6-7481-4054-b9f8-31430743d283 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:44:01.423075 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 43, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:44:01.423405 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Checking segment: {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:44:01.423783 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Bound using segment: {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:44:01.424208 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Bound port: af609d58-c97a-46bc-8c3b-93cc24aa231a, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'de8524f2-4726-4e27-8579-005e36672ca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '87782ba6-7481-4054-b9f8-31430743d283'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:44:01.424570 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.441493 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.502587 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.507039 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-cd467652-f8cf-4a41-92d1-edc54bfb3f45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:01.519590 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a02d47c-2343-4606-93ff-fe409a8b1efa,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:01.522786 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:44:01.524767 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:01.526503 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:44:01.527040 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.528370 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8a02d47c-2343-4606-93ff-fe409a8b1efa HTTP/1.1" status: 204  len: 168 time: 0.1742830
Jun 02 16:44:01.533368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.540769 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5237a522-b4ca-48a5-a897-a52351f9f813 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:01.612276 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:01.613160 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.614743 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] 10.222.0.20 "PUT /v2.0/ports/af609d58-c97a-46bc-8c3b-93cc24aa231a HTTP/1.1" status: 200  len: 1094 time: 1.2603471
Jun 02 16:44:01.615345 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:01.617926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f6d4505-217b-49db-9df1-a60e5015dd75" -d '{"events": [{"name": "network-changed", "server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:01.649369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Pushing event updated for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:01.661121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:01.709923 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8847a38-277e-4729-84c4-7dd135f11baf x-openstack-request-id: req-a8847a38-277e-4729-84c4-7dd135f11baf {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:01.710250 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:01.710539 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a8847a38-277e-4729-84c4-7dd135f11baf {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:01.710976 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a', 'status': 'completed', 'code': 200}
Jun 02 16:44:01.854639 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:01.873365 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-86057166-acb3-4cd4-9413-3a727672a953 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:01.875047 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-86057166-acb3-4cd4-9413-3a727672a953 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 1097 time: 0.1693611
Jun 02 16:44:01.882596 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6e4954-947e-4b05-b2f5-43928a622584 req-b344f316-f5b9-4e3f-ad94-0c0c11c3fa86 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:01.884015 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f6e4954-947e-4b05-b2f5-43928a622584 req-b344f316-f5b9-4e3f-ad94-0c0c11c3fa86 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.2247276
Jun 02 16:44:01.904442 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e666e21d-412d-4e45-b6f4-46b8e64eebe6 req-96c68c4b-fd6d-41ba-b62e-09fd0ac56f27 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:01.913836 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e666e21d-412d-4e45-b6f4-46b8e64eebe6 req-96c68c4b-fd6d-41ba-b62e-09fd0ac56f27 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1160619
Jun 02 16:44:01.962974 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e666e21d-412d-4e45-b6f4-46b8e64eebe6 req-62ba4b95-e888-4cac-85ca-483ad03c1ef1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0481076
Jun 02 16:44:01.967377 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-2cf0a61d-28c1-4b04-8a78-344e41c7e8de service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a HTTP/1.1" status: 200  len: 217 time: 0.0824142
Jun 02 16:44:02.037355 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f6e4954-947e-4b05-b2f5-43928a622584 req-2e68f0dd-ae74-4ace-b1cc-398ace2bb268 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0998747
Jun 02 16:44:02.055888 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-eff6c934-a768-4bd0-93d7-7e56e5b18a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:02.057670 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-eff6c934-a768-4bd0-93d7-7e56e5b18a29 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5c2a516d-6355-4d25-a0bf-a043ecc26f20 HTTP/1.1" status: 200  len: 854 time: 0.0809693
Jun 02 16:44:02.108533 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-bc3f6d4b-dfbc-485d-b5ce-f473f98e16ed service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87782ba6-7481-4054-b9f8-31430743d283&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0435336
Jun 02 16:44:02.249631 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bf7e3e-4cf6-413e-b99c-fc8e72a5e9d1 req-9e12a0bb-0aa9-497d-be83-c62c5d03c855 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:02.251180 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a2bf7e3e-4cf6-413e-b99c-fc8e72a5e9d1 req-9e12a0bb-0aa9-497d-be83-c62c5d03c855 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0851040
Jun 02 16:44:02.255943 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-d578b02d-78b2-4fa5-a0bd-38473496898a service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1400485
Jun 02 16:44:02.297494 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a2bf7e3e-4cf6-413e-b99c-fc8e72a5e9d1 req-b6e4f342-4645-4bd5-86c7-7201bf566db4 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403097
Jun 02 16:44:02.401872 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32359c45-818a-4443-a8f2-9d24cb0b733e req-08a15871-cb93-4c3f-8169-08322e4131c2 service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1384513
Jun 02 16:44:02.624179 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-2bc4469d-e9a7-4b39-99a0-8a972a32bc15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:02.625724 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-2bc4469d-e9a7-4b39-99a0-8a972a32bc15 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=72708e56387e47539c517fd7fe956ea3&device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 1097 time: 0.1691751
Jun 02 16:44:03.151103 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c58793-bc33-4ad7-bac6-5b9c7dec0f83 req-14ad491d-710d-4a1c-9859-163cc6ce237e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:03.152626 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95c58793-bc33-4ad7-bac6-5b9c7dec0f83 req-14ad491d-710d-4a1c-9859-163cc6ce237e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0846813
Jun 02 16:44:03.217202 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-95c58793-bc33-4ad7-bac6-5b9c7dec0f83 req-07a14060-6ca4-4aed-bb97-c99d2af14636 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0586348
Jun 02 16:44:03.244438 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ebad61-2e0a-45f6-8493-3210a14e80ee req-2b022000-3626-4179-8f09-4dd6773f3722 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:03.245895 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d2ebad61-2e0a-45f6-8493-3210a14e80ee req-2b022000-3626-4179-8f09-4dd6773f3722 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0929458
Jun 02 16:44:03.294899 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d2ebad61-2e0a-45f6-8493-3210a14e80ee req-b35755a6-fbb7-4772-8381-2f1344111609 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430889
Jun 02 16:44:03.487612 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb17406-1c6f-4ea4-9005-1d43d18da7b2 req-d4a93226-dd3a-43ea-abdd-f060d7b41f4b tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:03.489085 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8fb17406-1c6f-4ea4-9005-1d43d18da7b2 req-d4a93226-dd3a-43ea-abdd-f060d7b41f4b tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0846598
Jun 02 16:44:03.536755 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8fb17406-1c6f-4ea4-9005-1d43d18da7b2 req-0c7e03d5-d4bd-47f3-a8d4-496144a4375e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409634
Jun 02 16:44:03.689965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-d85070ea-d8c2-4601-9cc8-9d788910c3f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:03.691401 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-d85070ea-d8c2-4601-9cc8-9d788910c3f9 service neutron] 10.222.0.20 "GET /v2.0/networks?id=87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 200  len: 915 time: 0.1359067
Jun 02 16:44:03.750368 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:04.407124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28b6214-9d95-42d5-97be-ed2d4df965a0 req-3f1ddb42-48ab-4d75-b9a3-6aa01fa01adb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:04.408617 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a28b6214-9d95-42d5-97be-ed2d4df965a0 req-3f1ddb42-48ab-4d75-b9a3-6aa01fa01adb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0858076
Jun 02 16:44:04.453749 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a28b6214-9d95-42d5-97be-ed2d4df965a0 req-3f2a0d26-8707-49b8-b7e6-b63eaa3f1e76 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392559
Jun 02 16:44:04.495783 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d2f03a-1188-4eaf-999e-27acb0cf466f req-10a6eb03-b20a-4529-9718-2c5096a049e2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:04.497187 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-06d2f03a-1188-4eaf-999e-27acb0cf466f req-10a6eb03-b20a-4529-9718-2c5096a049e2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0858974
Jun 02 16:44:04.541666 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-06d2f03a-1188-4eaf-999e-27acb0cf466f req-ac40c3a4-10f5-4916-8fe0-ebc4fb5c99d3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386963
Jun 02 16:44:04.730645 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cfbcf9-f138-4d2e-a127-7cec90d86f31 req-328d0029-333f-4b62-b0f1-9dd20ad63440 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:04.732325 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f4cfbcf9-f138-4d2e-a127-7cec90d86f31 req-328d0029-333f-4b62-b0f1-9dd20ad63440 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0871718
Jun 02 16:44:04.875653 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f4cfbcf9-f138-4d2e-a127-7cec90d86f31 req-ea203aaa-2217-4629-bb8b-16592d10a8fa tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1371748
Jun 02 16:44:05.524464 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-f7fbbec0-4d86-40e6-bbca-64883aa16c47 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a HTTP/1.1" status: 200  len: 217 time: 0.0649145
Jun 02 16:44:05.651165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-a83541f5-cfca-415c-b05d-a04ff1a0b85a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:05.652671 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-a83541f5-cfca-415c-b05d-a04ff1a0b85a service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5c2a516d-6355-4d25-a0bf-a043ecc26f20 HTTP/1.1" status: 200  len: 854 time: 0.1201837
Jun 02 16:44:05.714198 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-60afe441-0c1b-4fb3-ac15-dd24ea492333 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=87782ba6-7481-4054-b9f8-31430743d283&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0523095
Jun 02 16:44:05.760526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6591067d-4f95-4543-91e1-2a7e8943f4b4 req-5fecca91-e5fb-43b7-acfa-f4e50c473601 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:05.762087 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6591067d-4f95-4543-91e1-2a7e8943f4b4 req-5fecca91-e5fb-43b7-acfa-f4e50c473601 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1806643
Jun 02 16:44:05.778166 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36326c5b-1264-43b5-b967-f1a3a198d5c0 req-129ca5ec-2b56-4da6-b78d-2848fe3b12d5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:05.779815 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-36326c5b-1264-43b5-b967-f1a3a198d5c0 req-129ca5ec-2b56-4da6-b78d-2848fe3b12d5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0991142
Jun 02 16:44:05.838132 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-36326c5b-1264-43b5-b967-f1a3a198d5c0 req-e6b3f64c-ac9f-40c8-9cb8-8f2e3e3a95ef tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478575
Jun 02 16:44:05.888345 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6591067d-4f95-4543-91e1-2a7e8943f4b4 req-f2142dea-c863-4f2c-88ce-61b4830e85ef tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1124141
Jun 02 16:44:05.908276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-98425497-8cfc-4230-a2ee-ab4902c9fca9 service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1851485
Jun 02 16:44:06.058806 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4f6d4505-217b-49db-9df1-a60e5015dd75 req-6717576b-7241-4c2c-bd0b-29202c5844dc service neutron] 10.222.0.20 "GET /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1361449
Jun 02 16:44:06.122334 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b15380e-5b25-4f50-bd19-0b34ded26769 req-1a9e34d8-2d4d-46ac-8623-37cb77067733 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:06.123826 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b15380e-5b25-4f50-bd19-0b34ded26769 req-1a9e34d8-2d4d-46ac-8623-37cb77067733 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0812871
Jun 02 16:44:06.171713 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b15380e-5b25-4f50-bd19-0b34ded26769 req-e669429c-c7b3-4240-869e-2c56569c079a tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414557
Jun 02 16:44:07.039881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c88030e2-6702-4448-986d-2f990d18b3d9 req-c2c54d12-adf8-4090-a15e-04bdd10d75e1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:07.041440 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c88030e2-6702-4448-986d-2f990d18b3d9 req-c2c54d12-adf8-4090-a15e-04bdd10d75e1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0862749
Jun 02 16:44:07.086536 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c88030e2-6702-4448-986d-2f990d18b3d9 req-37c97d05-b124-4215-b4f8-c9d5bb8c2941 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388834
Jun 02 16:44:07.100272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-196c0b88-e806-4f75-8d1e-6e1319af15a2 req-81ab7db1-d9ae-4c38-946f-86c3583cc2d2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:07.106343 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-196c0b88-e806-4f75-8d1e-6e1319af15a2 req-81ab7db1-d9ae-4c38-946f-86c3583cc2d2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0881255
Jun 02 16:44:07.155248 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-196c0b88-e806-4f75-8d1e-6e1319af15a2 req-2c3140b4-0907-4802-91ed-d08555a89645 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0469573
Jun 02 16:44:07.376591 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a196f380-5d9b-4ace-84ef-b00f037baede req-96a666d7-9d1c-40fd-a5a0-978d837eff58 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:07.379800 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a196f380-5d9b-4ace-84ef-b00f037baede req-96a666d7-9d1c-40fd-a5a0-978d837eff58 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0983160
Jun 02 16:44:07.433810 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a196f380-5d9b-4ace-84ef-b00f037baede req-66af04c3-396a-495f-8ab2-7aed2fd14f82 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496678
Jun 02 16:44:07.513217 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c759da-cb8d-4459-b152-407e9478fce6 req-8a3a0f4a-849b-4407-95a6-0f7b8a904b1d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:07.514753 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b3c759da-cb8d-4459-b152-407e9478fce6 req-8a3a0f4a-849b-4407-95a6-0f7b8a904b1d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0846992
Jun 02 16:44:07.560098 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b3c759da-cb8d-4459-b152-407e9478fce6 req-4fca4809-c7ff-4123-89ba-2d7e5b4f4bb5 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393233
Jun 02 16:44:08.291637 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4427d3-1539-4807-9ba9-04b2a9c82bb6 req-d3074545-f522-4871-80bd-650540ad56b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:08.293272 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fc4427d3-1539-4807-9ba9-04b2a9c82bb6 req-d3074545-f522-4871-80bd-650540ad56b6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0890481
Jun 02 16:44:08.339712 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fc4427d3-1539-4807-9ba9-04b2a9c82bb6 req-d8790155-517e-4f3a-b9d7-8aa42893e7f0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402713
Jun 02 16:44:08.625044 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0686d335-76c2-49d8-a2be-fb79429465cd req-7b1a7522-b985-478d-87ff-c299ca1be7c0 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:08.626596 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0686d335-76c2-49d8-a2be-fb79429465cd req-7b1a7522-b985-478d-87ff-c299ca1be7c0 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.0830112
Jun 02 16:44:08.680883 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0686d335-76c2-49d8-a2be-fb79429465cd req-e1ea00c6-eced-4e40-9886-0ee878a62709 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480883
Jun 02 16:44:08.754871 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e77bd3-74c8-4898-85c5-03654f76b33f req-fd54fdc9-79e1-4d13-ac63-a18b0ced8e67 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:08.756336 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d0e77bd3-74c8-4898-85c5-03654f76b33f req-fd54fdc9-79e1-4d13-ac63-a18b0ced8e67 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0841932
Jun 02 16:44:08.807296 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d0e77bd3-74c8-4898-85c5-03654f76b33f req-4e54ae6c-ea0a-4813-abb1-4e786ea32062 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429664
Jun 02 16:44:08.960200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-d264ee5f-8bac-4ca8-bdee-0add2bbe5b36 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:08.961558 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-d264ee5f-8bac-4ca8-bdee-0add2bbe5b36 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.0843055
Jun 02 16:44:09.040199 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-0099fa73-4082-4326-8da1-39741b4d5f3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.041829 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-0099fa73-4082-4326-8da1-39741b4d5f3a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1098 time: 0.0864854
Jun 02 16:44:09.104620 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Deleting port cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:44:09.105036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:09.193955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-b16b33d1-05cc-448e-93a3-80cdb6eceffd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.195415 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-b16b33d1-05cc-448e-93a3-80cdb6eceffd service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1386118
Jun 02 16:44:09.324024 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-b9fffb85-51c8-416f-9202-be615ff6ccbb service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 1001 time: 0.1205533
Jun 02 16:44:09.353623 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] For port cf7356d3-b193-4ccb-a580-fe9976ab37df, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=cf7356d3-b193-4ccb-a580-fe9976ab37df,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:09.354002 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:09.398534 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-44729b2d-561b-4e92-b647-15d46e9fbb39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.400021 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-44729b2d-561b-4e92-b647-15d46e9fbb39 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.0678916
Jun 02 16:44:09.491717 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-4036a5d3-946b-4e83-baff-7297dad315fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.492079 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-4036a5d3-946b-4e83-baff-7297dad315fe service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0843384
Jun 02 16:44:09.647993 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-27a32ecc-63d4-43b9-925f-4e47381e8f07 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1486790
Jun 02 16:44:09.770502 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b67380a-9ff0-40ba-be56-2608e215a574 req-559f96e7-e428-410b-9a5c-e917404ee2b5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.772034 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9b67380a-9ff0-40ba-be56-2608e215a574 req-559f96e7-e428-410b-9a5c-e917404ee2b5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 946 time: 0.2994924
Jun 02 16:44:09.809299 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a6b0a0a7-e01c-4fa1-967c-6e41d8feafc3 req-2e09bff9-3736-4c1b-8c67-a2682346876f service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1527505
Jun 02 16:44:09.840747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:09.841116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:09.841461 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Floating IP 332e7e03-e21b-4eb4-b91d-8e21b7e8a718 disassociated. External IP: 172.27.0.132, port: cf7356d3-b193-4ccb-a580-fe9976ab37df.
Jun 02 16:44:09.841820 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Calling delete_port for cf7356d3-b193-4ccb-a580-fe9976ab37df owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:44:09.857724 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9b67380a-9ff0-40ba-be56-2608e215a574 req-d9b2ccea-9f5a-4b59-8f1f-00a470cd0e4d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0770371
Jun 02 16:44:09.940631 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe5cc0a-596c-4547-9b7e-2ac5b5e1d0b6 req-3f3ea3b6-1d32-4c2e-accb-cf38188ddb19 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:09.943053 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bbe5cc0a-596c-4547-9b7e-2ac5b5e1d0b6 req-3f3ea3b6-1d32-4c2e-accb-cf38188ddb19 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 944 time: 0.1022477
Jun 02 16:44:10.006230 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-bbe5cc0a-596c-4547-9b7e-2ac5b5e1d0b6 req-7502baf8-ce73-4ccb-bd6b-197d4be5b1fb tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532072
Jun 02 16:44:10.080352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:10.088438 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:10.140753 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'Port': ['ID=cf7356d3-b193-4ccb-a580-fe9976ab37df,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:10.146890 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:10.237213 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bfd0cca-768d-4952-a7a9-201ef0694116 req-38ddf27f-bd4a-4bbc-aef2-f450f61995ed tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:10.238729 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9bfd0cca-768d-4952-a7a9-201ef0694116 req-38ddf27f-bd4a-4bbc-aef2-f450f61995ed tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.2420204
Jun 02 16:44:10.360082 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9bfd0cca-768d-4952-a7a9-201ef0694116 req-d58f5e4d-ea6b-4be3-9a5a-efcd9ca2381f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1154025
Jun 02 16:44:10.375944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:44:10.407168 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device af609d58-c97a-46bc-8c3b-93cc24aa231a details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:44:10.410728 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:44:10.452233 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: cf7356d3-b193-4ccb-a580-fe9976ab37df {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:44:10.452476 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device cf7356d3-b193-4ccb-a580-fe9976ab37df not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:44:10.596996 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:10.611787 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'af609d58-c97a-46bc-8c3b-93cc24aa231a', 'network_id': '87782ba6-7481-4054-b9f8-31430743d283', 'port_id': 'af609d58-c97a-46bc-8c3b-93cc24aa231a', 'mac_address': 'fa:16:3e:4f:79:0f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5c2a516d-6355-4d25-a0bf-a043ecc26f20', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:44:10.634558 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:44:10.644662 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:44:10.671927 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:44:10.672648 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18b460>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:43:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:10.720511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] No DVR routers for this DVR port cf7356d3-b193-4ccb-a580-fe9976ab37df on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:44:10.723837 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:10.729157 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-deleted', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:10.731782 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6907312e-9612-47c5-b2bb-3610ed64fe79" -d '{"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-deleted", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:10.744687 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:10.749705 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2a28c934-ff11-4a08-af10-d16a37dab536 req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "DELETE /v2.0/ports/cf7356d3-b193-4ccb-a580-fe9976ab37df HTTP/1.1" status: 204  len: 173 time: 1.7823050
Jun 02 16:44:10.766580 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af609d58-c97a-46bc-8c3b-93cc24aa231a {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:44:10.799611 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:10.800801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9308fd62-91c0-4c60-ad0a-ccea19caa730 x-openstack-request-id: req-9308fd62-91c0-4c60-ad0a-ccea19caa730 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:10.801332 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff41728c-da57-4bd7-92e2-18545bd4abc0", "name": "network-vif-deleted", "tag": "cf7356d3-b193-4ccb-a580-fe9976ab37df", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:10.801453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9308fd62-91c0-4c60-ad0a-ccea19caa730 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:10.803490 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff41728c-da57-4bd7-92e2-18545bd4abc0', 'name': 'network-vif-deleted', 'tag': 'cf7356d3-b193-4ccb-a580-fe9976ab37df', 'status': 'completed', 'code': 200}
Jun 02 16:44:10.857752 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:10.867307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:10.932741 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:44:11.127940 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f54b3751-33a1-493d-bde5-313006a826c1 req-99bdd167-1921-44f2-a557-89dc1a4a1c5b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:11.141648 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:11.146136 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f54b3751-33a1-493d-bde5-313006a826c1 req-99bdd167-1921-44f2-a557-89dc1a4a1c5b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:11.158869 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f54b3751-33a1-493d-bde5-313006a826c1 req-99bdd167-1921-44f2-a557-89dc1a4a1c5b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=ff41728c-da57-4bd7-92e2-18545bd4abc0 HTTP/1.1" status: 200  len: 210 time: 0.1377332
Jun 02 16:44:11.189193 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['af609d58-c97a-46bc-8c3b-93cc24aa231a'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:44:11.238308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.238647 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.239168 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.239488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.239804 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.248174 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.248548 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.250779 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.251307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.251652 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.251980 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.252310 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:11.266365 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.399s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:11.326374 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023bbab4-4526-4c6f-adf5-c65933bc583c req-97f77bc6-0eb4-46b2-95c3-42a7796a12bd tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:11.328271 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-023bbab4-4526-4c6f-adf5-c65933bc583c req-97f77bc6-0eb4-46b2-95c3-42a7796a12bd tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 945 time: 0.1236634
Jun 02 16:44:11.417169 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-023bbab4-4526-4c6f-adf5-c65933bc583c req-4bc8fb5b-ae4b-421d-8bf2-51c9058293c2 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0796113
Jun 02 16:44:11.505679 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18b460>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:11.519921 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:44:11.533964 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:44:11.534602 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18b460>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:43:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:11.616645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d6a496-9983-4b25-949e-a5810d4fb86a req-9d9fd4b3-c21b-459c-9ef9-c3c0fe477a4d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:11.619818 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-39d6a496-9983-4b25-949e-a5810d4fb86a req-9d9fd4b3-c21b-459c-9ef9-c3c0fe477a4d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0971320
Jun 02 16:44:11.685745 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-39d6a496-9983-4b25-949e-a5810d4fb86a req-2bb7ec0c-fd62-491b-9360-568f18e41968 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0604937
Jun 02 16:44:11.731034 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:44:12.065368 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18b460>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:12.070811 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22e1fd36-8035-430d-95b8-19d3812e38f3 None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:44:12.299508 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54564) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:12.333661 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55f3c50b-280f-46d2-8891-55406c4cbb8d None None] New status for floating IP 332e7e03-e21b-4eb4-b91d-8e21b7e8a718: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:44:12.369979 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.407789 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.415255 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device af609d58-c97a-46bc-8c3b-93cc24aa231a up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:44:12.495215 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.509201 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port af609d58-c97a-46bc-8c3b-93cc24aa231a completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:44:12.510123 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-11d4cf6f-3429-4c7c-b75d-d781b1d3b698 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:12.516221 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port af609d58-c97a-46bc-8c3b-93cc24aa231a triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:44:12.516729 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.534928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e9b4c9b-9c70-47be-ab19-875e72ba0d3e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:12.537498 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:12.649804 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.679248 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.680345 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "DELETE /v2.0/security-groups/9e9b4c9b-9c70-47be-ab19-875e72ba0d3e HTTP/1.1" status: 204  len: 168 time: 0.3797703
Jun 02 16:44:12.683606 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 54568) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:12.684102 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:12.686333 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60083095-e879-42ae-a3b3-551cab8e1d82" -d '{"events": [{"server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "name": "network-vif-plugged", "status": "completed", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:12.695710 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:12.705414 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.api.v2.resource [None req-c4a37b73-9bc2-4d24-9278-ed7130879ee9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] show failed (client error): The resource could not be found.
Jun 02 16:44:12.709285 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c4a37b73-9bc2-4d24-9278-ed7130879ee9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups/9e9b4c9b-9c70-47be-ab19-875e72ba0d3e HTTP/1.1" status: 404  len: 347 time: 0.0213783
Jun 02 16:44:12.709653 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 54574) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:12.719272 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:12.721980 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3edebd58-33fa-437c-9a3e-adc7bec1ef6e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:12.732124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e6e3fb-7e11-424a-8c8e-e362e1dd89ad req-42491b87-2baa-4882-87a1-227b9250f89f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:12.734378 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07e6e3fb-7e11-424a-8c8e-e362e1dd89ad req-42491b87-2baa-4882-87a1-227b9250f89f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 945 time: 0.2020016
Jun 02 16:44:12.767726 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbc79ac7-834a-4800-bad0-b27391b95f5a x-openstack-request-id: req-dbc79ac7-834a-4800-bad0-b27391b95f5a {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:12.768016 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "name": "network-vif-plugged", "status": "completed", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:12.768271 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-dbc79ac7-834a-4800-bad0-b27391b95f5a {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:12.768652 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a', 'code': 200}
Jun 02 16:44:12.799232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:12.802177 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:12.815760 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-07e6e3fb-7e11-424a-8c8e-e362e1dd89ad req-d8cf5a32-3eaa-4e26-b854-ce1c746dbc21 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0737839
Jun 02 16:44:13.173651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea3afa9-625b-42fc-8b7d-ddf503a83760 req-22a83ad7-9f0b-4480-a269-ccb8a5f8cbac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:13.174038 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dea3afa9-625b-42fc-8b7d-ddf503a83760 req-22a83ad7-9f0b-4480-a269-ccb8a5f8cbac service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 1099 time: 0.1461332
Jun 02 16:44:13.180316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Deleting port a2a91175-b8bf-4101-ab5f-3143eb52f9d7 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:44:13.180685 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.301087 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-dea3afa9-625b-42fc-8b7d-ddf503a83760 req-5bdfdfa4-05d1-4fd0-8222-87e1b9cb011d service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1068275
Jun 02 16:44:13.336646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.336927 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.467037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Calling delete_port for a2a91175-b8bf-4101-ab5f-3143eb52f9d7 owned by network:floatingip {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:44:13.590764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.594696 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:13.637901 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'Port': ['ID=a2a91175-b8bf-4101-ab5f-3143eb52f9d7,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:13.640902 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:13.737333 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.758970 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:13.760128 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "DELETE /v2.0/floatingips/332e7e03-e21b-4eb4-b91d-8e21b7e8a718 HTTP/1.1" status: 204  len: 168 time: 1.0490675
Jun 02 16:44:14.014697 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bda3bb-1980-4511-9bc4-90acd67dcbca req-68c87126-ddc2-4d04-8f09-c601a7d163d1 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:14.021049 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73bda3bb-1980-4511-9bc4-90acd67dcbca req-68c87126-ddc2-4d04-8f09-c601a7d163d1 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.0857456
Jun 02 16:44:14.021337 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54594) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:14.027559 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1141807690', 'description': 'tempest-description--1184820065'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:14.039129 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:14.057175 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:14.066892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:14.077098 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:14.103373 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73bda3bb-1980-4511-9bc4-90acd67dcbca req-b7bcbecc-0a5a-4de3-aed3-90c1b92f97b3 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794914
Jun 02 16:44:14.104203 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.133789 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:14.137753 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:14.140895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:14.146988 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:14.220788 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.224806 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.229278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1d61987f-65af-404b-9589-7ed439c22fd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:14.271823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a7660676-3435-405a-af71-7fecff93a3f6,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:14.276118 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:14.280089 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.282806 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.2600031
Jun 02 16:44:14.291511 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54602) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:14.296062 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group_rule': {'security_group_id': 'a7660676-3435-405a-af71-7fecff93a3f6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:14.302276 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:14.306839 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:14.313728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:14.317505 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:14.339083 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.404726 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.409540 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.417746 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:14.440036 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41586dd5-c05d-4581-b43b-9c31fd5ea53b,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:14.442999 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:14.449387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.450906 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9d17ae32-775e-4b0a-b95a-9e1e090a531e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1587930
Jun 02 16:44:14.453747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54604) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:14.458384 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'security_group_rule': {'security_group_id': 'a7660676-3435-405a-af71-7fecff93a3f6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:14.464227 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:14.468505 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:security_group_rule and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:14.471536 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:14.477867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:14.496973 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.571443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.575553 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.577705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:14.600656 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e81a56fc-8d34-4bea-bada-db947c118cd9,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:14.603846 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:14.611604 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.616466 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4522b920-4cf1-413c-b8d1-6355106e53b0 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1581385
Jun 02 16:44:14.616887 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54606) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:14.621952 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:14.628558 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:14.632940 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Usage tracker for resource:floatingip and tenant:545e33df5ea046a0bb2be1fb482f75fb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:14.636276 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:14.642706 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:14.656068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.805585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:14.948573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Allocated IP 172.27.0.36 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/a5f8beac-6d43-4f94-b7f6-17eb4d3718e0) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:44:15.101066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.130586 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.134763 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-77232730-29dd-439f-9e49-06d6e62e5bfc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:15.202363 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:44:15.205262 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:44:15.209471 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:44:15.239696 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=a5f8beac-6d43-4f94-b7f6-17eb4d3718e0,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:15.245956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:15.304616 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb72ba8-dfbd-4bed-9ab2-5589684c6779 req-60b49abf-f104-40bc-b607-927f72aac5ec tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:15.306271 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bb72ba8-dfbd-4bed-9ab2-5589684c6779 req-60b49abf-f104-40bc-b607-927f72aac5ec tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.0923188
Jun 02 16:44:15.306415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.359932 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4bb72ba8-dfbd-4bed-9ab2-5589684c6779 req-acc8921c-c572-4075-b7c2-56ca04aea425 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0450649
Jun 02 16:44:15.368252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.589051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.595468 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.599497 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:15.709577 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=a5f8beac-6d43-4f94-b7f6-17eb4d3718e0,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:15.714434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:15.722068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.749409 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:15.750791 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.1326771
Jun 02 16:44:15.991485 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-95b37573-608f-4fc3-b358-bfa393aa1f5c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--1141807690&fields=id&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 267 time: 0.0437686
Jun 02 16:44:16.173126 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-c4510ceb-f9e8-46e1-a69d-52113e21cc05 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:16.173775 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-c4510ceb-f9e8-46e1-a69d-52113e21cc05 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:network {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:16.193687 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-c4510ceb-f9e8-46e1-a69d-52113e21cc05 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:network {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:16.194936 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-c4510ceb-f9e8-46e1-a69d-52113e21cc05 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 817 time: 0.1847792
Jun 02 16:44:16.212918 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-4ddce471-ba52-4bb0-b728-574f33400b8b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/quotas/545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 375 time: 0.0116189
Jun 02 16:44:16.304617 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-85b2e48d-374c-467d-aab5-c79e5188913d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:16.320930 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-85b2e48d-374c-467d-aab5-c79e5188913d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:16.322279 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-85b2e48d-374c-467d-aab5-c79e5188913d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1026764
Jun 02 16:44:16.467853 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-de67a8a3-3458-4cfc-89a5-cc94987a8802 service neutron] 10.222.0.25 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1334054
Jun 02 16:44:16.603363 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-4fb75fc6-6251-4aec-a37a-33c22dd4fd1c service neutron] 10.222.0.25 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1296234
Jun 02 16:44:16.797704 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f53a7aca-60c3-4e47-ae1b-e8167cad9bee req-b249a556-4fa8-43f4-9783-11af175d6a1e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 210 time: 0.0428026
Jun 02 16:44:17.960714 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf26ccdb-096f-46c3-b413-63deb02f8d48 req-e33e09c1-b0ae-47bd-b6b4-3d8c4e2b3cc3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 210 time: 0.0495036
Jun 02 16:44:19.133186 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a7f05a3e-64d9-4030-bae8-666596e7bccc req-28464a13-bc08-4d9c-9f07-8b86ec65b7e2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 210 time: 0.0429945
Jun 02 16:44:20.220534 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-85bff891-8e85-4b26-9a7e-a92885f49cd4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:20.221300 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-85bff891-8e85-4b26-9a7e-a92885f49cd4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 817 time: 0.2499900
Jun 02 16:44:20.315805 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-780522b4-f3c8-44ff-a99b-23edaf850a07 req-39ca8c10-ddf7-4605-bd28-39efe58c2f8f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 210 time: 0.0564461
Jun 02 16:44:20.319974 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-613c6353-6d0a-4fbb-8a26-cb62da78e108 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 380 time: 0.0890312
Jun 02 16:44:20.329759 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'port': {'device_id': '84afab9f-76d5-4c69-8305-f3dc29798962', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'admin_state_up': True, 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'security_groups': ['a7660676-3435-405a-af71-7fecff93a3f6']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:20.485373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:20.497532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:20.508752 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Made reservation on behalf of 545e33df5ea046a0bb2be1fb482f75fb for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:44:20.512508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:20.696682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Allocated IP 172.20.0.8 (72edfd0c-8b13-49df-90c4-bff53519faeb/5fa6f4a1-7c91-4d10-977a-c26f520b3ec0/94aba472-894e-4275-81c6-19c87819e37c) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:44:20.924611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:20.941417 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Transition to ACTIVE for port object 94aba472-894e-4275-81c6-19c87819e37c will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:44:20.970774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:20.976382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-798f7051-4075-44d0-9e40-49a9d5d4385a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:21.043673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Network 72edfd0c-8b13-49df-90c4-bff53519faeb is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:44:21.046794 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:44:21.050585 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:44:21.081306 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:21.088016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:21.118518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:21.119115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:21.147057 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8212821
Jun 02 16:44:21.161802 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Request body: {'port': {'device_id': '84afab9f-76d5-4c69-8305-f3dc29798962', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:21.281916 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4081bfa8-7c9b-4c8d-8ee0-7f151812764a None None] Provisioning for port 94aba472-894e-4275-81c6-19c87819e37c completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:44:21.287337 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4081bfa8-7c9b-4c8d-8ee0-7f151812764a None None] Provisioning complete for port 94aba472-894e-4275-81c6-19c87819e37c triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:44:21.287995 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4081bfa8-7c9b-4c8d-8ee0-7f151812764a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:21.299530 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:21.345026 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-4081bfa8-7c9b-4c8d-8ee0-7f151812764a None None] Port 94aba472-894e-4275-81c6-19c87819e37c cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:44:21.516427 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2a2b27-92e8-4dff-809e-f329ca67bba3 req-34e04aae-0d90-4e16-9196-26525b3f5ff2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:21.517938 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1e2a2b27-92e8-4dff-809e-f329ca67bba3 req-34e04aae-0d90-4e16-9196-26525b3f5ff2 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 931 time: 0.0850618
Jun 02 16:44:21.564050 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-1e2a2b27-92e8-4dff-809e-f329ca67bba3 req-7660d29d-47c6-43e2-a659-33485b80d321 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:21.580679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-1e2a2b27-92e8-4dff-809e-f329ca67bba3 req-7660d29d-47c6-43e2-a659-33485b80d321 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:21.581946 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1e2a2b27-92e8-4dff-809e-f329ca67bba3 req-7660d29d-47c6-43e2-a659-33485b80d321 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0580435
Jun 02 16:44:21.665868 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:44:21.673472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:21.688982 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Transition to ACTIVE for port object 94aba472-894e-4275-81c6-19c87819e37c will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:44:21.698814 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:21.703270 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:21.876067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:21.879304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:21.952446 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Attempting to bind port 94aba472-894e-4275-81c6-19c87819e37c on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:44:21.952773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Attempting to bind port 94aba472-894e-4275-81c6-19c87819e37c by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:44:21.953086 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Attempting to bind port 94aba472-894e-4275-81c6-19c87819e37c on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:44:21.958041 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Port 94aba472-894e-4275-81c6-19c87819e37c on network 72edfd0c-8b13-49df-90c4-bff53519faeb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:44:21.958352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Attempting to bind port 94aba472-894e-4275-81c6-19c87819e37c on network 72edfd0c-8b13-49df-90c4-bff53519faeb {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:44:21.966133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:44:21.966133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Checking segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:44:21.966133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Bound using segment: {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:44:21.966133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Bound port: 94aba472-894e-4275-81c6-19c87819e37c, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9b9e4bab-a22b-478f-b1cb-4c73b58bba52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 670, 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:44:21.966133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:22.056004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:44:22.059191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:44:22.064178 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:22.067919 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-87afb314-735b-4c13-9539-f39506b93890 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:22.127839 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:22.128439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:22.129810 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] 10.222.0.20 "PUT /v2.0/ports/94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 1093 time: 0.9746830
Jun 02 16:44:22.130289 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:22.132646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea500550-89e0-4920-9c49-7908a72b881c" -d '{"events": [{"name": "network-changed", "server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:22.153398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:22.157062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:22.223507 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69cb28e3-04bd-40ea-97df-14d92ed18a3d x-openstack-request-id: req-69cb28e3-04bd-40ea-97df-14d92ed18a3d {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:22.223826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:22.224094 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-69cb28e3-04bd-40ea-97df-14d92ed18a3d {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:22.224503 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'status': 'completed', 'code': 200}
Jun 02 16:44:22.362258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-e0636d25-8866-4da3-8760-8c79dbb3a650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:22.363717 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-e0636d25-8866-4da3-8760-8c79dbb3a650 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1096 time: 0.1828191
Jun 02 16:44:22.441421 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-151a41a8-1978-47a1-a359-65b124966774 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 217 time: 0.0652535
Jun 02 16:44:22.507033 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-3197e6b9-6f36-4161-a0ab-0d0168605424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:22.508611 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-3197e6b9-6f36-4161-a0ab-0d0168605424 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0596519
Jun 02 16:44:22.595781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-690e5ec1-2d65-4c53-b144-4fe4ec9a28cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:22.596743 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-690e5ec1-2d65-4c53-b144-4fe4ec9a28cb service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0811017
Jun 02 16:44:22.751464 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ac4f0dd5-f441-4cad-bd25-8e91dffd61a3 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1354733
Jun 02 16:44:22.787575 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b574b1f-3bca-438d-a7d0-a6d88f0420a8 req-87b86630-cc64-417a-ad18-97283fba97ba tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:22.789008 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3b574b1f-3bca-438d-a7d0-a6d88f0420a8 req-87b86630-cc64-417a-ad18-97283fba97ba tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0804024
Jun 02 16:44:22.893580 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-045cb5bd-03a3-49fb-9e9d-ac9b568ec35a req-ce3de058-b39c-4faf-9d11-3ef66297a9b9 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1341951
Jun 02 16:44:22.938612 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3b574b1f-3bca-438d-a7d0-a6d88f0420a8 req-1e352859-0396-4d8d-b1bc-54462b8a2d03 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1431592
Jun 02 16:44:23.030698 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea500550-89e0-4920-9c49-7908a72b881c req-9677d1db-1dc8-4d54-bbeb-985fc9c9be13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:23.032157 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-9677d1db-1dc8-4d54-bbeb-985fc9c9be13 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1096 time: 0.0787506
Jun 02 16:44:23.175274 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea500550-89e0-4920-9c49-7908a72b881c req-671da7b9-2f5e-4d37-a51c-1c2d147fe38c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:23.176690 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-671da7b9-2f5e-4d37-a51c-1c2d147fe38c service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.1343246
Jun 02 16:44:23.245167 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-63bb5e09-f815-4a4d-a066-781f67f56e07 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 217 time: 0.0615697
Jun 02 16:44:23.315581 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea500550-89e0-4920-9c49-7908a72b881c req-c1681de8-f5b3-4bae-a340-5b6b51d17e87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:23.317077 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-c1681de8-f5b3-4bae-a340-5b6b51d17e87 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0652442
Jun 02 16:44:23.398527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea500550-89e0-4920-9c49-7908a72b881c req-43ad6c1d-0a4d-4479-b3da-7eac48813a64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:23.400209 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-43ad6c1d-0a4d-4479-b3da-7eac48813a64 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0749154
Jun 02 16:44:23.539262 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-24d55819-c3af-463a-88b7-74e5884c58ae service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313813
Jun 02 16:44:23.687034 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea500550-89e0-4920-9c49-7908a72b881c req-42149fc8-ed7b-47d7-9838-9534e92c40c9 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1394961
Jun 02 16:44:24.138975 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbd60bc-cc22-4dd8-a668-9b4fcf4be8eb req-f2a33e0a-42d4-4ca4-9358-97a40ff818a1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:24.139705 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-6bbd60bc-cc22-4dd8-a668-9b4fcf4be8eb req-f2a33e0a-42d4-4ca4-9358-97a40ff818a1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Synchronizing usage tracker for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:44:24.160164 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-6bbd60bc-cc22-4dd8-a668-9b4fcf4be8eb req-f2a33e0a-42d4-4ca4-9358-97a40ff818a1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Unset dirty status for tenant:545e33df5ea046a0bb2be1fb482f75fb on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:44:24.161695 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6bbd60bc-cc22-4dd8-a668-9b4fcf4be8eb req-f2a33e0a-42d4-4ca4-9358-97a40ff818a1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1094625
Jun 02 16:44:24.185919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54764) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:24.209354 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6bbd60bc-cc22-4dd8-a668-9b4fcf4be8eb req-1e116e0b-b26e-4a24-a1a0-7b0c7fd56f6c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418620
Jun 02 16:44:24.313297 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.328735 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:24.332725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Usage tracker for resource:security_group_rule and tenant:b28ea5f3321848ab869716b97e1f410b is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:24.335739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:24.341739 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:24.426803 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.432267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.440613 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-baf2d9ad-d60a-4943-a0f5-79916534f65c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:24.478928 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:44:24.483229 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b28ea5f3321848ab869716b97e1f410b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2961972
Jun 02 16:44:24.485338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=315289e1-68ca-4784-a06c-f3af65bf053b,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:24.486604 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 54768) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:24.488716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-db37f6f6-9650-41f3-ac88-2523715cb262 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:24.549648 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.577247 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.624178 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:24.632760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.638059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ff2de8f1-057f-46f5-a05d-856c05a0853d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:24.639199 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '94aba472-894e-4275-81c6-19c87819e37c', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:44:24.653286 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=315289e1-68ca-4784-a06c-f3af65bf053b,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:24.656617 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:24.662073 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.662646 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/315289e1-68ca-4784-a06c-f3af65bf053b HTTP/1.1" status: 204  len: 168 time: 0.1752257
Jun 02 16:44:24.703635 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.721140 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:44:24.739928 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:24.744169 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.746008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:24.815839 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:24.819333 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:24.976888 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 54776) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:24.996343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:24.997332 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['94aba472-894e-4275-81c6-19c87819e37c'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:44:25.012673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:25.016941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Usage tracker for resource:security_group_rule and tenant:26c625afc56448a38ab0219460136c26 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:25.020114 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:25.026572 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:25.112392 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.118447 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.127687 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-4e6a9992-52bf-42a4-9800-60afadca89ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:25.170908 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=26c625afc56448a38ab0219460136c26&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1925099
Jun 02 16:44:25.172798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c1138e3-ed15-4d47-bbb1-45d5bf7860c5,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:25.173798 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54778) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:25.175822 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:25.239249 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.274216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.388633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.394136 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-27029490-3b11-4c05-be0e-36b850306a62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:25.412729 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c1138e3-ed15-4d47-bbb1-45d5bf7860c5,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:25.418943 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:25.422594 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:25.423716 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1c1138e3-ed15-4d47-bbb1-45d5bf7860c5 HTTP/1.1" status: 204  len: 168 time: 0.2487345
Jun 02 16:44:25.440913 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-597ab676-c583-4284-8bd4-aac4ad058d8b req-608e6dad-fb49-4a40-9873-dc2969601ff4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:25.442376 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-597ab676-c583-4284-8bd4-aac4ad058d8b req-608e6dad-fb49-4a40-9873-dc2969601ff4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 944 time: 0.1127031
Jun 02 16:44:25.496790 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-597ab676-c583-4284-8bd4-aac4ad058d8b req-15ae53ea-dd1f-458d-9548-d0e03f8d7451 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0473468
Jun 02 16:44:25.798110 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-26112d57-6e4a-4331-9976-fbde2a3bdf3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:26.485637 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:44:26.559674 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 94aba472-894e-4275-81c6-19c87819e37c completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:44:26.564916 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 94aba472-894e-4275-81c6-19c87819e37c triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:44:26.565293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:26.719123 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544597ff-c410-4bff-b8bf-429f5f16d0bc req-c744215c-b4d4-4762-805c-47412e957154 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:26.721527 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-544597ff-c410-4bff-b8bf-429f5f16d0bc req-c744215c-b4d4-4762-805c-47412e957154 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 944 time: 0.0894103
Jun 02 16:44:26.722891 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:26.753986 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:26.756329 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fae5dce4-2c09-4a8c-b5e2-775cf31310e5" -d '{"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:26.765022 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:26.772089 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:26.774880 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:26.827542 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2879845-f409-41ec-8005-03e5dc1160f3 x-openstack-request-id: req-a2879845-f409-41ec-8005-03e5dc1160f3 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:26.828293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:26.828293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a2879845-f409-41ec-8005-03e5dc1160f3 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:26.828451 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'code': 200}
Jun 02 16:44:26.857979 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:26.861217 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:26.873201 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-544597ff-c410-4bff-b8bf-429f5f16d0bc req-d375df8e-06fc-40dd-9b7f-90fca36c97bb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1442962
Jun 02 16:44:27.087826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bbc470-f285-4ab4-91b6-f67c9057125b req-0ddad741-378a-4f9f-bf19-24432e88b037 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:27.089316 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-59bbc470-f285-4ab4-91b6-f67c9057125b req-0ddad741-378a-4f9f-bf19-24432e88b037 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1098 time: 0.0747488
Jun 02 16:44:27.133621 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-59bbc470-f285-4ab4-91b6-f67c9057125b req-291de037-1bb8-4b6a-aaa4-4ba610b0813f service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0346880
Jun 02 16:44:27.555008 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:44:28.068573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff659ea-3afd-4029-8c53-7d467121fa09 req-1abcfa2f-0ee5-4ba7-9941-0360066dcc28 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:28.070090 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-aff659ea-3afd-4029-8c53-7d467121fa09 req-1abcfa2f-0ee5-4ba7-9941-0360066dcc28 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.0807102
Jun 02 16:44:28.119300 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-aff659ea-3afd-4029-8c53-7d467121fa09 req-160f5935-c854-4598-84a8-8b53849a1dc4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433645
Jun 02 16:44:28.473407 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-484523a1-d7c4-41eb-8f35-a88de2d81464 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:28.748407 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:29.327540 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d2ad910-a84c-41cd-a9d6-6197d4acf643 req-ba901713-2d42-4b95-a031-28db9a2b6745 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:29.329030 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4d2ad910-a84c-41cd-a9d6-6197d4acf643 req-ba901713-2d42-4b95-a031-28db9a2b6745 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.0876870
Jun 02 16:44:29.377031 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4d2ad910-a84c-41cd-a9d6-6197d4acf643 req-817ab512-db8c-4428-a1a1-3d034b0aa390 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419557
Jun 02 16:44:30.196747 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:30.577392 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1eef98-3446-4587-81fe-15a46962da8e req-77cd0a44-cacd-48b7-89a5-e7b547fb2996 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:30.578914 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2f1eef98-3446-4587-81fe-15a46962da8e req-77cd0a44-cacd-48b7-89a5-e7b547fb2996 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.0862193
Jun 02 16:44:30.628278 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2f1eef98-3446-4587-81fe-15a46962da8e req-37240955-0728-4029-ba99-e5f9830a6843 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427830
Jun 02 16:44:31.845116 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:31.862776 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c601de-78bf-4777-bc8a-45bb05aada90 req-83c4eb1b-e0aa-42ac-bcde-fe923bc664f6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:31.864307 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18c601de-78bf-4777-bc8a-45bb05aada90 req-83c4eb1b-e0aa-42ac-bcde-fe923bc664f6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.1130712
Jun 02 16:44:31.911294 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18c601de-78bf-4777-bc8a-45bb05aada90 req-8c1ef03f-92e7-4aff-ad5c-e37d6f3171ee tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412612
Jun 02 16:44:32.096017 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fb4fc5-a73f-47ea-8a9f-ae4cc2cf55fd req-7d77f329-0d8a-476f-b344-2cc893b2229c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:32.097425 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-17fb4fc5-a73f-47ea-8a9f-ae4cc2cf55fd req-7d77f329-0d8a-476f-b344-2cc893b2229c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.0809293
Jun 02 16:44:32.110044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 54894) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:32.114523 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Request body: {'floatingip': {'port_id': '94aba472-894e-4275-81c6-19c87819e37c'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:44:32.191652 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:32.803247 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:32.808750 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:33.079461 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Floating IP 29f29c0a-bc51-49a1-8c3f-0878ac1d1097 associated. External IP: 172.27.0.36, port: 94aba472-894e-4275-81c6-19c87819e37c.
Jun 02 16:44:33.435158 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:44:33.626673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:44:33.631127 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:33.636533 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:44:33.646658 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:44:33.647266 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c296790>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:33.687533 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6beb2ad7-47f6-4ece-ba22-43e4f8fed0af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "PUT /v2.0/floatingips/29f29c0a-bc51-49a1-8c3f-0878ac1d1097 HTTP/1.1" status: 200  len: 990 time: 1.5737908
Jun 02 16:44:33.687533 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:33.687859 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d" -d '{"events": [{"name": "network-changed", "server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:33.742608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-934d31e0-6932-4ed0-a920-062245a6897f x-openstack-request-id: req-934d31e0-6932-4ed0-a920-062245a6897f {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:33.742926 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:33.743218 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-934d31e0-6932-4ed0-a920-062245a6897f {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:33.743646 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'status': 'completed', 'code': 200}
Jun 02 16:44:33.813322 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:33.835666 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:44:34.199294 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c296790>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '29f29c0a-bc51-49a1-8c3f-0878ac1d1097', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.36', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 444, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84afab9f-76d5-4c69-8305-f3dc29798962', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:44:15Z', 'updated_at': '2021-06-02T16:44:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:34.203537 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:44:34.212198 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:44:34.212810 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c296790>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:34.392467 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:44:34.761410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c296790>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '29f29c0a-bc51-49a1-8c3f-0878ac1d1097', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.36', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 444, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84afab9f-76d5-4c69-8305-f3dc29798962', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:44:15Z', 'updated_at': '2021-06-02T16:44:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:44:34.765798 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d0dcde1-b61e-4220-a9b3-c521b39552fd None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '29f29c0a-bc51-49a1-8c3f-0878ac1d1097', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'floating_ip_address': '172.27.0.36', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 444, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84afab9f-76d5-4c69-8305-f3dc29798962', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:44:15Z', 'updated_at': '2021-06-02T16:44:32Z', 'revision_number': 1, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:44:34.956270 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-691119e3-67f0-4a9e-9946-34f6809451a2 None None] New status for floating IP 29f29c0a-bc51-49a1-8c3f-0878ac1d1097: ACTIVE {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:44:35.207903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-6e6bd1eb-4246-4252-80b0-f146fc1b61a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:35.209373 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-6e6bd1eb-4246-4252-80b0-f146fc1b61a1 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1098 time: 0.0738621
Jun 02 16:44:35.346181 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-552ffa99-39f0-456d-a42f-b76d4d7a72be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:35.347689 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-552ffa99-39f0-456d-a42f-b76d4d7a72be service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.1299839
Jun 02 16:44:35.460092 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-34c7565e-fa3b-472b-9269-4a0185bcc1f6 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 1000 time: 0.1047711
Jun 02 16:44:35.529358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-4662748d-9bed-4bae-8496-150a0378ae38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:35.530910 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-4662748d-9bed-4bae-8496-150a0378ae38 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0608261
Jun 02 16:44:35.609146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-2724356c-acda-4577-b509-f605a563a015 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:35.610690 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-2724356c-acda-4577-b509-f605a563a015 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0733681
Jun 02 16:44:36.723491 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-eedce628-9578-48ee-b562-9fc4e7cee749 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1435256
Jun 02 16:44:38.658150 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6361ccb9-b986-454d-a1c5-c3d8d3908c8d req-8f4a0abf-37c7-4f98-b487-a9300238d0ab service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1411934
Jun 02 16:44:43.324353 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55030) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:43.453641 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.468579 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:43.472797 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Usage tracker for resource:security_group_rule and tenant:7363418c7f674a008c6a2de4aee3664c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:43.475600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:43.481861 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:43.567215 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.573833 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.580443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3bc63a38-f0c1-4503-81b6-0273e6e704c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:43.624243 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7363418c7f674a008c6a2de4aee3664c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2987897
Jun 02 16:44:43.625237 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cf798f9-f3a5-418a-97d7-01fd2de71176,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:43.627077 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55038) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:43.628415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c2da48a3-aaa9-43fb-8f9f-caf387451ebd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:43.684588 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.709564 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.734925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c7e383-cb45-4595-9f98-5e03cd41d803 req-0193f3ef-0fd5-4959-a899-eee32e31b314 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:43.736457 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-16c7e383-cb45-4595-9f98-5e03cd41d803 req-0193f3ef-0fd5-4959-a899-eee32e31b314 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.2043757
Jun 02 16:44:43.766908 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.771791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0143fe46-0bee-4e73-b3a1-b8557fc7a4a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:43.781422 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-16c7e383-cb45-4595-9f98-5e03cd41d803 req-5446bf91-5bb7-4d42-aa22-306e6bdf8aed tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391603
Jun 02 16:44:43.783874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cf798f9-f3a5-418a-97d7-01fd2de71176,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:43.787815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:43.793144 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:43.805713 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4cf798f9-f3a5-418a-97d7-01fd2de71176 HTTP/1.1" status: 204  len: 168 time: 0.1688950
Jun 02 16:44:44.104435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55046) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:44.121893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.138708 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:44.142852 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Usage tracker for resource:security_group_rule and tenant:d70bab42670a41348c69fe34dc2ddee4 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:44.145832 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:44.152421 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:44.244189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.249673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.256145 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1c66ddd5-2537-4a67-b5cc-5e4a27a54288 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:44.295174 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d70bab42670a41348c69fe34dc2ddee4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1895058
Jun 02 16:44:44.296039 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3f99a6f-de60-4ddb-98c4-5211171ed148,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:44.298454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55048) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:44.299311 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6c62b3b3-f77f-470e-9f3a-22d4b50ef36f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:44.360241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.387992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.441004 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.449417 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1622f8e6-e66f-437c-941f-0a48d9946ea2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:44.469760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3f99a6f-de60-4ddb-98c4-5211171ed148,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:44.471809 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:44.474120 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a3f99a6f-de60-4ddb-98c4-5211171ed148 HTTP/1.1" status: 204  len: 168 time: 0.1744077
Jun 02 16:44:44.475209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:45.003573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f31863-e69d-4fc0-8676-1122b41a5d04 req-e211ba6c-0256-403f-ba17-e89127282ccc tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:45.005026 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-63f31863-e69d-4fc0-8676-1122b41a5d04 req-e211ba6c-0256-403f-ba17-e89127282ccc tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.1138275
Jun 02 16:44:45.052524 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-63f31863-e69d-4fc0-8676-1122b41a5d04 req-01cc5408-f218-40d0-89a9-9e4c3f78a277 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415306
Jun 02 16:44:45.695698 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-7c27a3cd-8204-411a-bc48-cc3419e23b5e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:45.697188 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-7c27a3cd-8204-411a-bc48-cc3419e23b5e tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.0865848
Jun 02 16:44:45.839187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Deleting port af609d58-c97a-46bc-8c3b-93cc24aa231a {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:44:45.839529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:45.975996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] For port af609d58-c97a-46bc-8c3b-93cc24aa231a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=af609d58-c97a-46bc-8c3b-93cc24aa231a,segment=NetworkSegment(de8524f2-4726-4e27-8579-005e36672ca4),segment_id=de8524f2-4726-4e27-8579-005e36672ca4)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:44:45.976315 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:46.196292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Calling delete_port for af609d58-c97a-46bc-8c3b-93cc24aa231a owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:44:46.242778 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df42d61c-4d95-4e13-8d71-e419277edf22 req-3d47ad45-735d-46d3-9208-270faaad24b8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:46.244416 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-df42d61c-4d95-4e13-8d71-e419277edf22 req-3d47ad45-735d-46d3-9208-270faaad24b8 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/ports?device_id=8de93482-70cd-4a5c-90a8-02f6167dc196 HTTP/1.1" status: 200  len: 946 time: 0.0853407
Jun 02 16:44:46.292570 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-df42d61c-4d95-4e13-8d71-e419277edf22 req-0a2810b0-0f88-4944-a3dc-5597ef9f5508 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.25 "GET /v2.0/security-groups?id=8cb54ad4-55cc-4987-b203-566abb562d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397766
Jun 02 16:44:46.319920 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:46.326542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2c212bc7-4df4-4a9f-8895-e95390bc8a03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:46.333499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['af609d58-c97a-46bc-8c3b-93cc24aa231a'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:44:46.378485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Pushing event deleted for resources: {'Port': ['ID=af609d58-c97a-46bc-8c3b-93cc24aa231a,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:46.381694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:46.467041 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] No DVR routers for this DVR port af609d58-c97a-46bc-8c3b-93cc24aa231a on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:44:46.470001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:46.474497 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'name': 'network-vif-deleted', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:44:46.476815 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dd7f72f-7013-48de-8539-46a4aeeb2f2b" -d '{"events": [{"server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "name": "network-vif-deleted", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:44:46.491062 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-31e11c0a-ae1b-4ecc-8973-82f254755594 req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] 10.222.0.20 "DELETE /v2.0/ports/af609d58-c97a-46bc-8c3b-93cc24aa231a HTTP/1.1" status: 204  len: 173 time: 0.7874181
Jun 02 16:44:46.525920 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:44:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ac8bf14-246b-45ef-bdd6-4d4619d47df3 x-openstack-request-id: req-3ac8bf14-246b-45ef-bdd6-4d4619d47df3 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:44:46.526281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8de93482-70cd-4a5c-90a8-02f6167dc196", "name": "network-vif-deleted", "tag": "af609d58-c97a-46bc-8c3b-93cc24aa231a", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:44:46.526542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-3ac8bf14-246b-45ef-bdd6-4d4619d47df3 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:44:46.527357 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8de93482-70cd-4a5c-90a8-02f6167dc196', 'name': 'network-vif-deleted', 'tag': 'af609d58-c97a-46bc-8c3b-93cc24aa231a', 'status': 'completed', 'code': 200}
Jun 02 16:44:51.280099 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device af609d58-c97a-46bc-8c3b-93cc24aa231a no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:44:51.316415 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: af609d58-c97a-46bc-8c3b-93cc24aa231a {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:44:51.316829 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device af609d58-c97a-46bc-8c3b-93cc24aa231a not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:44:53.478016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55182) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:53.597728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.618457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:53.622519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Usage tracker for resource:security_group_rule and tenant:ff2e56dd745b45229c80c7dbad1ec80f is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:53.625635 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:53.631548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:53.742567 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.747341 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.757365 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b2fdf9c2-86e1-4bee-843a-fc6137b59332 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:53.805743 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ff2e56dd745b45229c80c7dbad1ec80f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3221588
Jun 02 16:44:53.805743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03ee83b0-60e1-4839-a242-2bcc1a4788bf,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:53.806239 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:53.806498 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55188) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:53.871425 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.904602 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.973125 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:53.983828 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-20cade82-3e04-4115-976f-22f3f2adce40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:53.998638 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03ee83b0-60e1-4839-a242-2bcc1a4788bf,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:54.001238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:54.002569 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.003614 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/03ee83b0-60e1-4839-a242-2bcc1a4788bf HTTP/1.1" status: 204  len: 168 time: 0.1959720
Jun 02 16:44:54.301434 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55204) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:54.321104 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.335739 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:44:54.339878 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Usage tracker for resource:security_group_rule and tenant:ae36dfe27732453d87e93a0191ba5360 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:44:54.342728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:44:54.348737 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:44:54.441500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.446238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.454763 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e681fd89-9411-453e-9ea6-88dacee8496a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:54.506570 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8dc7afd1-0318-414d-98e2-af7a41160400,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:54.516557 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ae36dfe27732453d87e93a0191ba5360&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2111695
Jun 02 16:44:54.516557 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:54.517250 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55208) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:44:54.582005 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.607812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.664674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.668752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6da08f56-4529-481c-bb97-1cadae2a0dad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:44:54.686553 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8dc7afd1-0318-414d-98e2-af7a41160400,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:44:54.697657 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.698006 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.698374 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.698734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.699093 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.699450 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.699812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.700192 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.700560 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.700896 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.701259 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.701627 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:44:54.709459 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:44:54.714984 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:54.715931 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-0931e7f3-1095-4a1f-bc29-b21846e06b36 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8dc7afd1-0318-414d-98e2-af7a41160400 HTTP/1.1" status: 204  len: 168 time: 0.1979835
Jun 02 16:44:55.701704 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ee0c26-d513-4b0e-b2e4-e836fee46783 req-a52ecf66-3a5a-4108-9f05-a61b67642f65 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:55.706112 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-61ee0c26-d513-4b0e-b2e4-e836fee46783 req-a52ecf66-3a5a-4108-9f05-a61b67642f65 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0999572
Jun 02 16:44:55.758311 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-61ee0c26-d513-4b0e-b2e4-e836fee46783 req-41e0efb8-4221-4c81-8801-b5a417425e0f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0479693
Jun 02 16:44:55.794453 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-67471b23-dce3-4e47-b907-640a977efb71 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:57.040704 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce30a435-bd5a-444a-9f27-49219c81603e req-8bf10f1c-2a35-4619-9949-863bbd8925ba tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:57.043488 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ce30a435-bd5a-444a-9f27-49219c81603e req-8bf10f1c-2a35-4619-9949-863bbd8925ba tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1354604
Jun 02 16:44:57.099388 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ce30a435-bd5a-444a-9f27-49219c81603e req-b9857ebe-44eb-4048-ad0b-f53e78d3ca1e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0487740
Jun 02 16:44:58.356915 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18bfec97-703c-45f0-9b08-021347ecc3c8 req-492c978b-27ff-43aa-85cc-cb162cb8c463 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:58.358556 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18bfec97-703c-45f0-9b08-021347ecc3c8 req-492c978b-27ff-43aa-85cc-cb162cb8c463 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1294599
Jun 02 16:44:58.416761 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-18bfec97-703c-45f0-9b08-021347ecc3c8 req-ed0dae1e-c105-4df9-9daa-1d4faa9ee6ed tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503721
Jun 02 16:44:58.477671 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-df412b11-d56d-4b1d-9db5-abc2245e994b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:58.744104 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:44:59.618876 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed3cfec-6684-4b9f-ae6a-79a17368d3ef req-b6aa9fac-c380-4953-b00d-7673c9d1eebb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:44:59.620243 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ed3cfec-6684-4b9f-ae6a-79a17368d3ef req-b6aa9fac-c380-4953-b00d-7673c9d1eebb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0810225
Jun 02 16:44:59.671446 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ed3cfec-6684-4b9f-ae6a-79a17368d3ef req-f4fc90fa-0484-4082-8bbe-b892bd868c3f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454075
Jun 02 16:45:00.199564 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:00.874894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5888984-a2ce-46e4-89f6-072e289cbb55 req-e2f99f3a-d592-45d2-b82d-7d7ffeab2a8d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:00.876331 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e5888984-a2ce-46e4-89f6-072e289cbb55 req-e2f99f3a-d592-45d2-b82d-7d7ffeab2a8d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0888946
Jun 02 16:45:00.927276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e5888984-a2ce-46e4-89f6-072e289cbb55 req-714d446f-b9cb-415d-b124-e7fcacb62ee5 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452211
Jun 02 16:45:01.849573 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:02.020469 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-ad60dece-6b1a-4a4e-b95e-6be58d28e496 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:02.021961 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-ad60dece-6b1a-4a4e-b95e-6be58d28e496 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1098 time: 0.1806669
Jun 02 16:45:02.221967 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-83eab005-8772-442f-b05c-4c7c88b088bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:02.223081 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-83eab005-8772-442f-b05c-4c7c88b088bd service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1554766
Jun 02 16:45:02.234927 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bda4705-5af3-44e6-8bf7-405fcb5721f2 req-dbbfbc6c-913a-4d4e-bb42-6b73c628d6ac tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:02.236336 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7bda4705-5af3-44e6-8bf7-405fcb5721f2 req-dbbfbc6c-913a-4d4e-bb42-6b73c628d6ac tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.2000926
Jun 02 16:45:02.281222 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7bda4705-5af3-44e6-8bf7-405fcb5721f2 req-fb586df5-f19a-4b31-ad40-46966333625a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390346
Jun 02 16:45:03.478349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ccbc4d-8098-4e69-8ea4-b2110dc414de req-05623772-9a39-4a92-8796-2085ae959a5b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:03.479859 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-96ccbc4d-8098-4e69-8ea4-b2110dc414de req-05623772-9a39-4a92-8796-2085ae959a5b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0879743
Jun 02 16:45:03.526700 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-96ccbc4d-8098-4e69-8ea4-b2110dc414de req-dc6efafb-e06f-4135-a2ca-7aa6286989c7 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407310
Jun 02 16:45:03.755268 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:04.555267 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:45:04.725101 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb96df7-c9a4-4e17-ac36-e579d1d17cd6 req-d5163f41-bbfa-4a4d-a588-0f7508961b81 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:04.726492 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ffb96df7-c9a4-4e17-ac36-e579d1d17cd6 req-d5163f41-bbfa-4a4d-a588-0f7508961b81 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0841455
Jun 02 16:45:04.864148 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ffb96df7-c9a4-4e17-ac36-e579d1d17cd6 req-212f7896-97f1-4b9a-a8a8-ecde35f34a58 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1314194
Jun 02 16:45:05.069150 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-e87a1c90-bb3c-4c16-927a-fd4e212013f0 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 1001 time: 0.1092703
Jun 02 16:45:05.135589 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-45f0bb43-7ae3-4cc8-ab1b-9d40945a6707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:05.137045 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-45f0bb43-7ae3-4cc8-ab1b-9d40945a6707 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.0578649
Jun 02 16:45:05.218511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-2fdf7fd6-a793-43ef-823e-5e110971a542 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:05.221104 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-2fdf7fd6-a793-43ef-823e-5e110971a542 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0769601
Jun 02 16:45:05.360321 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-b9dc2479-d42c-420f-9ec9-c7599f5b251e service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1314824
Jun 02 16:45:05.503280 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8e6b636-cab8-4201-a82a-09531d4c957e req-23d8f7fa-3b14-457b-837a-e765e8a6eca5 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1343143
Jun 02 16:45:06.086078 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0fad09-0e4f-466a-9e99-63c5efd565c3 req-58065cce-6166-47f2-951a-cbf1ba7dab40 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:06.087797 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2b0fad09-0e4f-466a-9e99-63c5efd565c3 req-58065cce-6166-47f2-951a-cbf1ba7dab40 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1120150
Jun 02 16:45:06.140079 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2b0fad09-0e4f-466a-9e99-63c5efd565c3 req-97489b98-ab83-4df2-b3f8-b82873084a6d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452714
Jun 02 16:45:07.329741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df890585-2786-4c69-b93f-a95fbd9f897c req-69bd92b8-cad6-464a-bc98-ea1ec981693d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:07.331304 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-df890585-2786-4c69-b93f-a95fbd9f897c req-69bd92b8-cad6-464a-bc98-ea1ec981693d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0812907
Jun 02 16:45:07.382129 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-df890585-2786-4c69-b93f-a95fbd9f897c req-75939533-7288-495c-9fa5-98b6450ba7c6 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444038
Jun 02 16:45:08.592955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c71bf6-ee3b-401b-9490-ffc500ca6659 req-6df27369-4fce-4a81-bad3-65b02d55a432 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:08.594503 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-99c71bf6-ee3b-401b-9490-ffc500ca6659 req-6df27369-4fce-4a81-bad3-65b02d55a432 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0885468
Jun 02 16:45:08.645378 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-99c71bf6-ee3b-401b-9490-ffc500ca6659 req-541cf1d3-a9ab-4757-9103-76de983972e3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427375
Jun 02 16:45:09.169137 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55412) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:09.300718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.318135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:09.322364 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Usage tracker for resource:security_group_rule and tenant:5fb45fee5d8f43a8906a15943aa8c5cb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:09.325755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:09.332299 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:09.420429 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.431059 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.440878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c20d004d-ffee-43c4-821b-63307001879c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:09.480185 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5fb45fee5d8f43a8906a15943aa8c5cb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3099349
Jun 02 16:45:09.481877 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ca97a44-152e-4e98-8601-d9bb58ecd22d,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:09.483059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55418) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:09.485076 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ebb2a6a1-badb-46cf-86b4-95c16578bad9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:09.558943 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.585168 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.643505 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.647318 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0e19a7e9-daef-4a06-843a-b394b552fc59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:09.660193 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ca97a44-152e-4e98-8601-d9bb58ecd22d,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:09.672288 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.672581 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.672885 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.673231 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.673632 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.673956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.674289 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.674620 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.674953 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.675647 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.675647 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.675934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:09.679069 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:09.682545 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4ca97a44-152e-4e98-8601-d9bb58ecd22d HTTP/1.1" status: 204  len: 168 time: 0.1960602
Jun 02 16:45:09.682545 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:09.960196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762adfe0-b3c7-42bd-841e-e5c5a3cf034a req-c6a48c71-4094-479f-ae9e-dd44ba0f1ed2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:09.962110 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-762adfe0-b3c7-42bd-841e-e5c5a3cf034a req-c6a48c71-4094-479f-ae9e-dd44ba0f1ed2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.2010367
Jun 02 16:45:09.992250 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55426) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:10.009841 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.012735 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-762adfe0-b3c7-42bd-841e-e5c5a3cf034a req-c19f8805-35d4-4d49-88c0-8cf33294f9f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440729
Jun 02 16:45:10.025422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:10.029315 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Usage tracker for resource:security_group_rule and tenant:a3edcf4ed0494e74a0c6d2ef63fba871 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:10.032612 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:10.038652 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:10.145121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.150104 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.157672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3289f613-037b-4b79-a00e-1773ad6fe704 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:10.199587 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a3edcf4ed0494e74a0c6d2ef63fba871&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2061939
Jun 02 16:45:10.200655 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f162d78b-2bbe-4608-ad57-8240058e0ace,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:10.202635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55430) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:10.203869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:10.272245 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.299020 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.360728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.364609 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-51cb80d4-13af-4625-a805-ec1bf0e18d85 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:10.384890 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f162d78b-2bbe-4608-ad57-8240058e0ace,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:10.390238 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:10.397632 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:10.399154 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f162d78b-2bbe-4608-ad57-8240058e0ace HTTP/1.1" status: 204  len: 168 time: 0.1884830
Jun 02 16:45:11.225036 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260ef90d-d8fc-4866-889f-10b2d4ae9213 req-d3ef9b54-73f2-43ec-a889-7b712ed356e2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:11.226709 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-260ef90d-d8fc-4866-889f-10b2d4ae9213 req-d3ef9b54-73f2-43ec-a889-7b712ed356e2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0912969
Jun 02 16:45:11.277642 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-260ef90d-d8fc-4866-889f-10b2d4ae9213 req-fdaf3a1b-e9d6-43a9-bd27-bc6e864895f9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405936
Jun 02 16:45:11.835500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21dadff-b329-4293-9f60-fdfdc9ba4726 req-2e1245b3-d126-4c2e-b70c-8f8fb5230572 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:11.842166 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a21dadff-b329-4293-9f60-fdfdc9ba4726 req-2e1245b3-d126-4c2e-b70c-8f8fb5230572 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1109207
Jun 02 16:45:11.884548 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a21dadff-b329-4293-9f60-fdfdc9ba4726 req-c6e03df0-0ad5-40bd-b7a9-b6d7a3809dd6 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411153
Jun 02 16:45:11.894793 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-f9866249-21a2-417f-a68b-37f551574ac0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:11.896409 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-f9866249-21a2-417f-a68b-37f551574ac0 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 1098 time: 0.0945342
Jun 02 16:45:12.038019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-1430363a-f8bf-495e-9e35-b5f0f1222bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:12.039525 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-1430363a-f8bf-495e-9e35-b5f0f1222bb6 service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1360586
Jun 02 16:45:12.156685 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-5fb99866-8830-4b57-b766-43c6ad285c52 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 200  len: 1001 time: 0.1096995
Jun 02 16:45:12.223184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-cb96abc2-5fba-4b8b-bbb4-884811049e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:12.224596 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-cb96abc2-5fba-4b8b-bbb4-884811049e8f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.0605886
Jun 02 16:45:12.309986 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-5025e48d-5999-4d4a-b5d7-dab0f8243625 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:12.311473 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-5025e48d-5999-4d4a-b5d7-dab0f8243625 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0795221
Jun 02 16:45:12.456735 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-0022a281-f6df-41fc-b044-1c4b4e4c79e4 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1365535
Jun 02 16:45:12.593064 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e5f5887-5b24-4155-833d-97dd5b493705 req-a06c64c0-b3a4-4145-8056-2b725a028c45 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282890
Jun 02 16:45:13.111431 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da41ec5-80c7-4eca-9034-76367f31c185 req-5706e3a2-9a32-437e-9ea1-3d092b6b9e0c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:13.113068 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6da41ec5-80c7-4eca-9034-76367f31c185 req-5706e3a2-9a32-437e-9ea1-3d092b6b9e0c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.1082342
Jun 02 16:45:13.189621 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6da41ec5-80c7-4eca-9034-76367f31c185 req-f633758e-99c7-4453-949f-f751024d6738 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0697668
Jun 02 16:45:14.386578 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864d6a17-a151-4b20-bdfc-60f21f4f13b3 req-1937bcac-744b-402d-822b-a819edf2192b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:14.388048 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-864d6a17-a151-4b20-bdfc-60f21f4f13b3 req-1937bcac-744b-402d-822b-a819edf2192b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.0876234
Jun 02 16:45:14.432909 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-864d6a17-a151-4b20-bdfc-60f21f4f13b3 req-26e69467-793a-45d6-ade0-2d2dac5e4780 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392308
Jun 02 16:45:17.729512 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55550) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:17.794154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Deleting subnet 5c2a516d-6355-4d25-a0bf-a043ecc26f20 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:45:17.797407 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:17.871527 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:17.936452 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.212225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.216494 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:18.253330 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5c2a516d-6355-4d25-a0bf-a043ecc26f20,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:18.256432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:18.257404 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.266676 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9229c51f-142e-404e-b09f-4b045f40f0cb admin admin] 10.222.0.25 "DELETE /v2.0/subnets/5c2a516d-6355-4d25-a0bf-a043ecc26f20 HTTP/1.1" status: 204  len: 168 time: 0.5329738
Jun 02 16:45:18.267038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55570) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:18.380213 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.519002 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.533758 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac87430>,) {'filters': {'network_id': ['87782ba6-7481-4054-b9f8-31430743d283']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:18.548700 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac87430>, 'de8524f2-4726-4e27-8579-005e36672ca4') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:18.548994 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7ac87430>, 'de8524f2-4726-4e27-8579-005e36672ca4') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:18.562470 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.580489 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.586725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Releasing vlan 657 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:45:18.587122 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:45:18.600522 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:45:18.682251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.687475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:18.700585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:18.711310 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Pushing event deleted for resources: {'Network': ['ID=87782ba6-7481-4054-b9f8-31430743d283,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:18.714597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:18.721715 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a36de826-45dc-48f0-9670-104b7f529a21 admin admin] 10.222.0.25 "DELETE /v2.0/networks/87782ba6-7481-4054-b9f8-31430743d283 HTTP/1.1" status: 204  len: 168 time: 0.4537849
Jun 02 16:45:18.923375 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55578) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:18.977858 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7dc907be-bcba-456c-9171-85a82bad0713 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=72708e56387e47539c517fd7fe956ea3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0525463
Jun 02 16:45:18.981274 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55580) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:19.045491 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:19.072702 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:19.134180 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:19.138298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-41f81c67-8805-438a-8666-51cbe89c24e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:19.152490 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cb54ad4-55cc-4987-b203-566abb562d0e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:19.155507 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:19.168476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:19.169620 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-dfbbdaa1-d30e-4a28-bb86-9954be7b8d1d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8cb54ad4-55cc-4987-b203-566abb562d0e HTTP/1.1" status: 204  len: 168 time: 0.1874223
Jun 02 16:45:19.976790 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55610) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:20.094104 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1139778888-network', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:20.099581 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:20.104045 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Usage tracker for resource:network and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:20.107194 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:20.114805 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:20.127475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Made reservation on behalf of 6dfc0270498549a6a449e9aa4beb945e for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:20.129841 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.142640 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.157010 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:20.161041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:20.163932 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:20.170122 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:20.254174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.259435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.262983 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8ae6de66-0ab6-49a0-b5c2-d28e8075cbe8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:20.300155 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] vlan segment allocate from pool success with {'vlan_id': 682, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:45:20.308817 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b27892ff-78fd-4d6d-af61-20aff85cbd99,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:20.312001 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:20.317876 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.318299 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Added segment 6e3737ad-312d-4822-9043-cd5248d86a63 of type vlan for network 51db2abb-3ad8-4a20-b616-e97be139cc03
Jun 02 16:45:20.345156 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.375548 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.377020 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:20.377747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.381033 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-93690313-062c-4a4e-ae29-88ce13261e5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:20.479729 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Pushing event updated for resources: {'Network': ['ID=51db2abb-3ad8-4a20-b616-e97be139cc03,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:20.482794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:20.484687 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.5062993
Jun 02 16:45:20.488172 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55614) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:20.490176 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:45:20.493228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Request body: {'subnet': {'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1139778888-subnet', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:20.498258 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:20.502124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Usage tracker for resource:subnet and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:20.504919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:20.511254 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:20.522657 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Made reservation on behalf of 6dfc0270498549a6a449e9aa4beb945e for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:20.525245 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:20.878905 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55624) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:20.999577 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.014320 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.018210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-55255777-5037-4a9d-b47b-eef4e3c68448 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:21.019238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:21.024338 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Usage tracker for resource:security_group_rule and tenant:3784bc9ec7b64389bbf159228a30cea3 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:21.027466 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:21.033547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:21.086592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Pushing event updated for resources: {'Subnet': ['ID=49ee6390-6171-4f16-99cc-b1c7e54d783e,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:21.091588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:21.099703 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Checking segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:21.100044 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Network hostable DHCP agents. Network: 51db2abb-3ad8-4a20-b616-e97be139cc03, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:45:21.119803 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:45:21.130948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 51db2abb-3ad8-4a20-b616-e97be139cc03) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:21.140862 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32fab10f-1833-4bbf-9a7b-f64ddf4ae6f4 None None] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:21.141206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:21.141831 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.168553 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6766815
Jun 02 16:45:21.168820 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55628) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:21.173932 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:21.179291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:21.183323 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Usage tracker for resource:router and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:21.186181 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:21.192179 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:21.214764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.219516 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.224717 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.226038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.228354 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-09706f32-5488-4f49-bff7-aba6353a2b3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:21.243713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.275480 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3784bc9ec7b64389bbf159228a30cea3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3930509
Jun 02 16:45:21.275480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89a5d064-c8f6-474e-928e-b86b3f35d2f4,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:21.277351 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-cba01511-7a05-42fc-bf4b-a126a2cbf90a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:21.277845 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55630) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:21.337951 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.363931 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-51db2abb-3ad8-4a20-b616-e97be139cc03', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:45:21.364788 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.366191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.422200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.427610 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-8eea547e-9400-4b31-b09a-bb4b4122cd4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:21.443596 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89a5d064-c8f6-474e-928e-b86b3f35d2f4,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:21.447159 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:21.453511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.457805 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/89a5d064-c8f6-474e-928e-b86b3f35d2f4 HTTP/1.1" status: 204  len: 168 time: 0.1788309
Jun 02 16:45:21.528666 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.534607 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Allocated IP 172.20.0.2 (51db2abb-3ad8-4a20-b616-e97be139cc03/49ee6390-6171-4f16-99cc-b1c7e54d783e/01999a47-7ce7-4481-b3d5-195bd1e68bde) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:21.747017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.757348 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Transition to ACTIVE for port object 01999a47-7ce7-4481-b3d5-195bd1e68bde will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:21.776424 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Transition to ACTIVE for port object 01999a47-7ce7-4481-b3d5-195bd1e68bde will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:21.783461 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.788318 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-9ff959f0-9604-44a6-b332-88736d0db253 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:21.851249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:21.854649 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:21.858499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:21.862546 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.892450 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.900478 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Pushing event updated for resources: {'Port': ['ID=01999a47-7ce7-4481-b3d5-195bd1e68bde,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:21.940164 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.940652 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.941009 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.941405 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.941834 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.942218 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.942541 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.942863 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.943184 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.943498 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.943812 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.944123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:21.956865 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:21.967131 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Attempting to bind port 01999a47-7ce7-4481-b3d5-195bd1e68bde on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:21.967956 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Attempting to bind port 01999a47-7ce7-4481-b3d5-195bd1e68bde by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:21.968437 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Attempting to bind port 01999a47-7ce7-4481-b3d5-195bd1e68bde on network 51db2abb-3ad8-4a20-b616-e97be139cc03 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:21.976217 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 44, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:21.976698 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Checking segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:21.977561 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:21.978074 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Bound using segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:21.978623 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Bound port: 01999a47-7ce7-4481-b3d5-195bd1e68bde, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:21.979094 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.047530 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Allocated IP 172.27.0.138 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/d0891102-04ad-4704-91ad-cad011c5bb0c) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:22.087055 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] For port 01999a47-7ce7-4481-b3d5-195bd1e68bde, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:22.090584 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] For port 01999a47-7ce7-4481-b3d5-195bd1e68bde, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=01999a47-7ce7-4481-b3d5-195bd1e68bde,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:22.095678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.105500 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:22.195540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Pushing event updated for resources: {'Port': ['ID=01999a47-7ce7-4481-b3d5-195bd1e68bde,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:22.198930 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:22.228485 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.252619 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55654) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:22.262659 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.267261 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:22.329345 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:22.332406 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:22.344360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:22.415934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2094890525-network', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:22.422535 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:22.427035 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Usage tracker for resource:network and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:22.432852 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:22.441712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:22.458062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Made reservation on behalf of b110174a94dd4df89cc6dc7b34bb7170 for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:22.461354 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.481191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.497742 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:22.502403 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:22.506501 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:22.513832 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:22.538786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Pushing event updated for resources: {'Port': ['ID=d0891102-04ad-4704-91ad-cad011c5bb0c,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:22.541221 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 01999a47-7ce7-4481-b3d5-195bd1e68bde up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:22.565405 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:22.614917 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 01999a47-7ce7-4481-b3d5-195bd1e68bde completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:22.620255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.625199 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.628720 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-97a46e5f-287e-4de3-b21d-71fce27a5c68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:22.656110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] vlan segment allocate from pool success with {'vlan_id': 665, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:45:22.668948 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=781601f9-3579-4401-9b5e-e634e22b43f2,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:22.672269 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:22.675090 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.675522 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Added segment 179e8978-8edc-4f99-a70d-1f4e8d45205a of type vlan for network 424e3c29-adf6-44ca-a36f-5399047a7f0c
Jun 02 16:45:22.707673 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.739357 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.740695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:22.741297 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.746138 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:22.844531 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.5907414
Jun 02 16:45:22.845497 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Pushing event updated for resources: {'Network': ['ID=424e3c29-adf6-44ca-a36f-5399047a7f0c,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:22.847470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55658) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:22.853239 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Request body: {'subnet': {'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2094890525-subnet', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:22.857682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:22.858807 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:22.859342 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:45:22.862781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Usage tracker for resource:subnet and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:22.865641 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:22.871379 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:22.883562 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Made reservation on behalf of b110174a94dd4df89cc6dc7b34bb7170 for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:22.887275 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12253020'] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:22.967867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.316159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf9fe536-c9e7-4e60-bd31-5fbeec2f568a None None] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:23.369015 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.413129 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-11421082', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12253006'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.417040 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:23.467121 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Provisioning for port 01999a47-7ce7-4481-b3d5-195bd1e68bde completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:23.476958 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Provisioning complete for port 01999a47-7ce7-4481-b3d5-195bd1e68bde triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:23.477868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.486597 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:23.490357 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:23.497714 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Checking segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:23.498049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Network hostable DHCP agents. Network: 424e3c29-adf6-44ca-a36f-5399047a7f0c, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:45:23.515796 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:45:23.525611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 424e3c29-adf6-44ca-a36f-5399047a7f0c) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:23.535389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:23.536067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.545917 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f01dedb-5cbf-45f0-ac63-d4a8c5d7ca53 None None] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:23.566457 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7172620
Jun 02 16:45:23.568623 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55662) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:23.573895 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:23.578603 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:23.584100 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Usage tracker for resource:router and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:23.584562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Router e6c14c61-82c7-4abb-8187-fce6c8e16daa is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98278) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:45:23.586640 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:23.592823 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:23.603529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.604580 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.621165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.768870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:23.783410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Sync routers for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:23.800628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Notify callbacks [] for router, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.802036 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 2.6323431
Jun 02 16:45:23.804864 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55664) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:23.859651 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:23.860289 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c394640>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:23.893143 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:23.929832 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.080443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-424e3c29-adf6-44ca-a36f-5399047a7f0c', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:45:24.080803 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.090593 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] For port 01999a47-7ce7-4481-b3d5-195bd1e68bde, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=01999a47-7ce7-4481-b3d5-195bd1e68bde,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:24.115313 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.122125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:24.243338 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:24.349012 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.385203 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.466864 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Pushing event updated for resources: {'Port': ['ID=01999a47-7ce7-4481-b3d5-195bd1e68bde,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:24.478991 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:24.560562 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Allocated IP 172.27.0.20 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/e1995789-755d-40e6-abbe-114db4d51d26) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:24.569873 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-314063b6-20f2-458f-a57f-096bc34895d9 None None] Provisioning complete for port 01999a47-7ce7-4481-b3d5-195bd1e68bde triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:24.570409 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-314063b6-20f2-458f-a57f-096bc34895d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.635134 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.697155 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Allocated IP 172.20.0.2 (424e3c29-adf6-44ca-a36f-5399047a7f0c/0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9/ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:24.728244 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.761975 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:24.766683 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:24.827465 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:24.830600 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:24.834676 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:24.861731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Allocated IP 172.20.0.1 (51db2abb-3ad8-4a20-b616-e97be139cc03/49ee6390-6171-4f16-99cc-b1c7e54d783e/99e53edd-801f-43ae-b33e-b76333967555) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:24.871509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Pushing event updated for resources: {'Port': ['ID=e1995789-755d-40e6-abbe-114db4d51d26,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:24.876322 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:24.965301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c394640>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:22Z', 'revision_number': 3, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:24.998920 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Checking router: e6c14c61-82c7-4abb-8187-fce6c8e16daa for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:24.999170 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Updating router e6c14c61-82c7-4abb-8187-fce6c8e16daa port d0891102-04ad-4704-91ad-cad011c5bb0c binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:25.024274 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.041804 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Transition to ACTIVE for port object 99e53edd-801f-43ae-b33e-b76333967555 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:25.069862 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.075393 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:25.079131 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.106302 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.130683 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Transition to ACTIVE for port object ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:25.137585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:25.140452 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:25.144307 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:25.178378 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Pushing event updated for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:25.182876 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:25.198146 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Transition to ACTIVE for port object ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:25.210018 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.212131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.237254 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:25.293013 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.333203 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:25.346063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:25.352782 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:25.362384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Pushing event updated for resources: {'Port': ['ID=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:25.422078 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:25.489901 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.579150 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-383b2206-6dfb-460b-bd39-50d8c58bcfe2 None None] Provisioning for port 99e53edd-801f-43ae-b33e-b76333967555 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:25.592315 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Attempting to bind port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:25.592597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Attempting to bind port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:25.593095 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Attempting to bind port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead on network 424e3c29-adf6-44ca-a36f-5399047a7f0c {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:25.604918 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-383b2206-6dfb-460b-bd39-50d8c58bcfe2 None None] Provisioning complete for port 99e53edd-801f-43ae-b33e-b76333967555 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:25.605383 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-383b2206-6dfb-460b-bd39-50d8c58bcfe2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.645976 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 44, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:25.646398 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Checking segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:25.646757 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.647150 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Bound using segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:25.647634 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Bound port: ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:25.648008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.711257 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.765719 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-383b2206-6dfb-460b-bd39-50d8c58bcfe2 None None] Port 99e53edd-801f-43ae-b33e-b76333967555 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:25.793434 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.827283 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Transition to ACTIVE for port object d0891102-04ad-4704-91ad-cad011c5bb0c will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:25.829704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-bd88e050-c6ae-42c8-a841-6d47b6e49faf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.839479 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.845398 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:25.857146 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.863942 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.878299 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] For port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:25.895387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-61980e40-48d1-4d01-8d96-fe97396aacb4 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:25.899715 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] For port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:25.921990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.945293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Attempting to bind port d0891102-04ad-4704-91ad-cad011c5bb0c on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:25.945739 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Attempting to bind port d0891102-04ad-4704-91ad-cad011c5bb0c by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:25.946047 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Attempting to bind port d0891102-04ad-4704-91ad-cad011c5bb0c on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:25.952068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Pushing event updated for resources: {'Port': ['ID=d0891102-04ad-4704-91ad-cad011c5bb0c,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:25.957220 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:25.957848 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.027s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:25.986265 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 44, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:25.986733 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:25.987044 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:25.987436 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:25.987948 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Bound port: d0891102-04ad-4704-91ad-cad011c5bb0c, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:25.988325 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:26.003233 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:26.013267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Pushing event updated for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:26.017485 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:26.065543 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98277) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:45:26.094554 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Pushing event updated for resources: {'Port': ['ID=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:26.098664 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:26.101126 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] For port d0891102-04ad-4704-91ad-cad011c5bb0c, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:26.104712 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] For port d0891102-04ad-4704-91ad-cad011c5bb0c, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d0891102-04ad-4704-91ad-cad011c5bb0c,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:26.111736 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:26.115600 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:26.179955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:26.182335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:26.198885 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:26.199527 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c394640>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:26.252765 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Pushing event updated for resources: {'Port': ['ID=d0891102-04ad-4704-91ad-cad011c5bb0c,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:26.261081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:26.306680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:26.331309 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Sync routers for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:26.345643 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:26.349708 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b9b20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:26.369424 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:26.373163 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 2.8009162
Jun 02 16:45:26.373383 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55670) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:26.488562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Router e6c14c61-82c7-4abb-8187-fce6c8e16daa has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:26.520007 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:26.683123 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:26.685078 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 01999a47-7ce7-4481-b3d5-195bd1e68bde up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:26.862477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:26.884315 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] 10.222.0.25 "PUT /v2.0/routers/e6c14c61-82c7-4abb-8187-fce6c8e16daa/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0782886
Jun 02 16:45:26.933022 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 01999a47-7ce7-4481-b3d5-195bd1e68bde triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:26.933022 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.085729 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b9b20>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 3, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:27.092809 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Checking router: 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:27.093256 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Updating router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 port e1995789-755d-40e6-abbe-114db4d51d26 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:27.182866 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-df8908eb-63ea-47d1-be15-6acf2ad6df5a None None] Provisioning complete for port 99e53edd-801f-43ae-b33e-b76333967555 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:27.183237 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-df8908eb-63ea-47d1-be15-6acf2ad6df5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.206142 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.315371 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-df8908eb-63ea-47d1-be15-6acf2ad6df5a None None] Port 99e53edd-801f-43ae-b33e-b76333967555 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:27.456937 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:27.579598 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.615059 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c70138e7-405a-4c90-b577-c09497384165 None None] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:27.651881 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c394640>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 2, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:27.668672 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35c3fdc-f503-4032-a15d-743617974604 None None] The sync data for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi is: [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 2, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:27.675698 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:27.775081 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Provisioning for port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:27.788800 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Provisioning complete for port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:27.789174 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.872343 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.880626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Allocated IP 172.20.0.1 (424e3c29-adf6-44ca-a36f-5399047a7f0c/0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9/916e1087-9c2c-4810-8927-cdee4290b02b) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:27.885530 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Transition to ACTIVE for port object e1995789-755d-40e6-abbe-114db4d51d26 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:27.902110 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:27.908566 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-8497-472d-a1c8-4dea1c2715ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:27.915877 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55696) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:27.989739 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Attempting to bind port e1995789-755d-40e6-abbe-114db4d51d26 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:27.990102 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Attempting to bind port e1995789-755d-40e6-abbe-114db4d51d26 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:27.990464 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Attempting to bind port e1995789-755d-40e6-abbe-114db4d51d26 on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:27.999617 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Pushing event updated for resources: {'Port': ['ID=e1995789-755d-40e6-abbe-114db4d51d26,revision_number=2']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:28.003352 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 44, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:28.003992 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:28.004113 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.004681 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:28.004946 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Bound port: e1995789-755d-40e6-abbe-114db4d51d26, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:28.005311 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.022540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.053626 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.054895 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.054895 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.054895 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.054895 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98280) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:28.069086 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:28.078125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] For port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:28.087449 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.089438 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:28.103720 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.129023 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-752295776-network', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:28.138606 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:28.147643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Usage tracker for resource:network and tenant:49e660cc561d45bd879c28c5698e0dbb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:28.151820 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Transition to ACTIVE for port object 916e1087-9c2c-4810-8927-cdee4290b02b will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:28.153461 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:28.161829 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] For port e1995789-755d-40e6-abbe-114db4d51d26, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:28.163838 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:28.170047 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] For port e1995789-755d-40e6-abbe-114db4d51d26, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e1995789-755d-40e6-abbe-114db4d51d26,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:28.181656 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.193100 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Pushing event updated for resources: {'Port': ['ID=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:28.207546 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:28.208288 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:28.213822 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Made reservation on behalf of 49e660cc561d45bd879c28c5698e0dbb for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:28.216965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.233148 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.254532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:28.259942 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Usage tracker for resource:security_group_rule and tenant:49e660cc561d45bd879c28c5698e0dbb is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:28.264405 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:28.272746 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:28.277851 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.283735 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:28.302804 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Pushing event updated for resources: {'Port': ['ID=e1995789-755d-40e6-abbe-114db4d51d26,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:28.307758 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:28.333256 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:28.334258 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b9b20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:44:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:28.420995 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4e2ef324-16e9-499a-861d-eba607aed926 None None] Provisioning complete for port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:28.421652 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4e2ef324-16e9-499a-861d-eba607aed926 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.502339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:28.510414 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e23a476c-d5d0-472d-8f35-7f5e7b03e66f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.512710 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:28.526366 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:28.527451 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:28.606279 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Pushing event updated for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:28.613874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:28.621872 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:28.635448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.755229 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:28.757254 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.794488 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:28.950656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-6ab13dd3-f7dd-46cc-95d3-b0d4b4166a9a None None] Provisioning for port 916e1087-9c2c-4810-8927-cdee4290b02b completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:28.956228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-6ab13dd3-f7dd-46cc-95d3-b0d4b4166a9a None None] Provisioning complete for port 916e1087-9c2c-4810-8927-cdee4290b02b triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:28.956932 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-6ab13dd3-f7dd-46cc-95d3-b0d4b4166a9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.032149 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-6ab13dd3-f7dd-46cc-95d3-b0d4b4166a9a None None] Port 916e1087-9c2c-4810-8927-cdee4290b02b cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:29.075758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.086358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.092364 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1c348577-17a5-4afa-9d99-eeb2270199d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:29.093814 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b9b20>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 3, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:29.098143 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5675280-3436-4ff9-977a-09d805dca32d None None] The sync data for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi is: [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 3, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:29.124738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] vlan segment allocate from pool success with {'vlan_id': 694, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:45:29.124738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.157155 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.157528 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Added segment b95ee089-a680-4b57-bb97-869ed2123671 of type vlan for network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10
Jun 02 16:45:29.158654 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cd9c1b8-ef77-4ab8-ad84-32a1316721be,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:29.189024 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:29.249568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.390277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.394508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:29.395368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.401916 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:29.554548 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.6375847
Jun 02 16:45:29.557788 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55704) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:29.558485 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Pushing event updated for resources: {'Network': ['ID=aa8f1ae5-659f-4737-b2e8-7c1e8d416c10,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:29.562561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:29.564968 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.565267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Request body: {'subnet': {'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-752295776-subnet', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:29.571395 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:29.571899 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.572769 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:45:29.575765 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Usage tracker for resource:subnet and tenant:49e660cc561d45bd879c28c5698e0dbb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:29.584578 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:29.591442 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:29.601051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:29.609588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Made reservation on behalf of 49e660cc561d45bd879c28c5698e0dbb for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:29.613334 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.689645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:29.694469 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Pushing event updated for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:29.699332 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:29.845740 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:29.846929 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:30.147548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:30.166956 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-0ce02a8f-2d9c-4a40-a34d-8aaf02dc676e None None] Provisioning complete for port 916e1087-9c2c-4810-8927-cdee4290b02b triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:30.167508 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-0ce02a8f-2d9c-4a40-a34d-8aaf02dc676e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.185500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.193071 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:30.288430 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-0ce02a8f-2d9c-4a40-a34d-8aaf02dc676e None None] Port 916e1087-9c2c-4810-8927-cdee4290b02b cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:30.294303 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.306692 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Checking segment: {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:30.307042 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Network hostable DHCP agents. Network: aa8f1ae5-659f-4737-b2e8-7c1e8d416c10, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:45:30.309905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dcde0601-cc3f-44e0-8824-27392d2c697c,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:30.312750 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:30.339228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:45:30.351688 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, aa8f1ae5-659f-4737-b2e8-7c1e8d416c10) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:30.367206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:30.367592 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be98f4a5-1dfa-4263-8873-ffcca9417343 None None] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:30.368169 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.405096 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9962a6c3-4cae-4712-9964-320c6149a710 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.8427241
Jun 02 16:45:30.405494 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55722) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:30.413258 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:30.426100 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:30.436095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Usage tracker for resource:router and tenant:49e660cc561d45bd879c28c5698e0dbb is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:30.440762 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:30.455170 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:30.475741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.478705 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.497239 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.566695 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:30.580202 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] 10.222.0.25 "PUT /v2.0/routers/6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.2056692
Jun 02 16:45:30.621319 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771f8be0-ce73-450c-8f6c-5a36ec23d9b6 req-c937621e-35b6-4fb9-bd56-ad7f4843f177 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:30.623198 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-771f8be0-ce73-450c-8f6c-5a36ec23d9b6 req-c937621e-35b6-4fb9-bd56-ad7f4843f177 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.1459098
Jun 02 16:45:30.678189 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e1995789-755d-40e6-abbe-114db4d51d26 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:30.697162 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-771f8be0-ce73-450c-8f6c-5a36ec23d9b6 req-0017dca4-1e95-4f43-8504-1a1d59df537d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0664270
Jun 02 16:45:30.802824 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:45:30.803792 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.818788 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port e1995789-755d-40e6-abbe-114db4d51d26 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:30.829710 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port e1995789-755d-40e6-abbe-114db4d51d26 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:30.829710 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:30.861176 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Sync routers for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:30.948116 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:30.948766 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3761f0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:30.972110 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.239644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.244656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Allocated IP 172.20.0.2 (aa8f1ae5-659f-4737-b2e8-7c1e8d416c10/dcde0601-cc3f-44e0-8824-27392d2c697c/5ea6ecf6-4c90-465c-92d6-9770304fa84d) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:31.274555 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port e1995789-755d-40e6-abbe-114db4d51d26, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e1995789-755d-40e6-abbe-114db4d51d26,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:31.297740 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.298644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d0891102-04ad-4704-91ad-cad011c5bb0c up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:31.319697 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.330608 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:31.346203 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55738) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:31.352711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1857741650-network', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:31.354799 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.360339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:31.368923 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Usage tracker for resource:network and tenant:c649aeae15ef49fab852d41fce91f791 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:31.372328 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-96dd7453-5750-4958-bee9-d28878ee2abb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:31.372505 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:31.385769 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:31.403496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Made reservation on behalf of c649aeae15ef49fab852d41fce91f791 for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:31.406792 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.419013 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.436388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:31.440667 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Usage tracker for resource:security_group_rule and tenant:c649aeae15ef49fab852d41fce91f791 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:31.443665 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:31.449518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:31.518715 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Allocated IP 172.27.0.35 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/89b77bd3-6ac4-44af-93e1-19a72b61d5cd) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:31.528990 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Sync routers for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:31.545837 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:31.546880 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77ebb2e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:31.557937 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.564546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.567747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94caff10-22cf-4910-9da6-76ba64ddf8df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:31.600501 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b96c2f99-d6dc-4b21-9167-2f4ea55a9879,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:31.605897 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:31.614480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] vlan segment allocate from pool success with {'vlan_id': 699, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:45:31.626690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.627248 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Added segment 9568214b-a39b-4f26-b48e-a4e73cd5ee69 of type vlan for network 3361e9cb-0a49-460c-b917-d490b80bed43
Jun 02 16:45:31.648693 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=e1995789-755d-40e6-abbe-114db4d51d26,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:31.662039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.667048 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:31.698733 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.700758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:31.701359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.708101 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:31.733094 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.741780 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port d0891102-04ad-4704-91ad-cad011c5bb0c completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:31.762912 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port d0891102-04ad-4704-91ad-cad011c5bb0c triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:31.763533 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.770366 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.779394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-97f69c59-29f7-4c11-a9f5-0229e7cfc59d tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:31.837898 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Pushing event updated for resources: {'Network': ['ID=3361e9cb-0a49-460c-b917-d490b80bed43,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:31.845978 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4985185
Jun 02 16:45:31.846610 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55742) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:31.848195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:31.850025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:31.854022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Request body: {'subnet': {'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1857741650-subnet', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:31.859192 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:31.860823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:31.865832 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:31.872081 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Usage tracker for resource:subnet and tenant:c649aeae15ef49fab852d41fce91f791 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:31.875631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:31.882901 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:31.883949 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 3361e9cb-0a49-460c-b917-d490b80bed43 details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:45:31.887686 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:31.897937 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Made reservation on behalf of c649aeae15ef49fab852d41fce91f791 for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:31.903965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12253020'] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:31.923303 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Pushing event updated for resources: {'Port': ['ID=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:31.937717 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:31.961249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.163563 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.231949 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Transition to ACTIVE for port object 5ea6ecf6-4c90-465c-92d6-9770304fa84d will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:32.253215 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.268791 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77ebb2e0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 2, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:32.273984 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Checking router: 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:32.274343 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Updating router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 port 916e1087-9c2c-4810-8927-cdee4290b02b binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:32.280675 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Transition to ACTIVE for port object 5ea6ecf6-4c90-465c-92d6-9770304fa84d will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:32.290645 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port d0891102-04ad-4704-91ad-cad011c5bb0c, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d0891102-04ad-4704-91ad-cad011c5bb0c,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:32.295549 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.299890 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:32.331880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d5f976-3f6d-4293-a19c-0f9c6ee425c3 req-4f51518f-02fb-47c0-a5a6-16b326fe1a0e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:32.333590 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a7d5f976-3f6d-4293-a19c-0f9c6ee425c3 req-4f51518f-02fb-47c0-a5a6-16b326fe1a0e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.3990304
Jun 02 16:45:32.344496 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.351257 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.386540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3761f0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 2, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:32.391266 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:32.400199 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a7d5f976-3f6d-4293-a19c-0f9c6ee425c3 req-2bcc8d6c-0ad1-43c7-bf98-c3ed8c717c8e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0557396
Jun 02 16:45:32.408723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:32.416537 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Checking router: e6c14c61-82c7-4abb-8187-fce6c8e16daa for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:32.419365 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-11421082', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12253006'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.420325 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Updating router e6c14c61-82c7-4abb-8187-fce6c8e16daa port 99e53edd-801f-43ae-b33e-b76333967555 binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:32.436350 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e67056d8-5db7-4bbc-b5da-e94fedd45bca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:32.464196 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:32.473679 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Pushing event updated for resources: {'Port': ['ID=5ea6ecf6-4c90-465c-92d6-9770304fa84d,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:32.487026 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:32.487547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.125s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:32.497711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0374350a-1856-4ca5-89da-31ef107805e8,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:32.502672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:32.531577 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Checking segment: {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:32.531927 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Network hostable DHCP agents. Network: 3361e9cb-0a49-460c-b917-d490b80bed43, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:45:32.553093 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.553361 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Network 3361e9cb-0a49-460c-b917-d490b80bed43 is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:45:32.559250 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e1995789-755d-40e6-abbe-114db4d51d26 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:32.568058 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 3361e9cb-0a49-460c-b917-d490b80bed43) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:32.578253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:32.578968 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.605098 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e092da2-4991-4210-8d8c-ff2ae2f3cfb6 None None] Network 3361e9cb-0a49-460c-b917-d490b80bed43 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:32.617263 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7677472
Jun 02 16:45:32.617952 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55744) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:32.623900 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:32.629294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:32.634348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Usage tracker for resource:router and tenant:c649aeae15ef49fab852d41fce91f791 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:32.637871 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:32.646393 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:32.661053 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-758983', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2028'] for router, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.662790 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-758944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683702', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-702106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2037'] for router, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.684272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.706801 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.817452 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.833523 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Transition to ACTIVE for port object 916e1087-9c2c-4810-8927-cdee4290b02b will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:32.843346 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.852593 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:32.868739 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Attempting to bind port 5ea6ecf6-4c90-465c-92d6-9770304fa84d on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:32.869260 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Attempting to bind port 5ea6ecf6-4c90-465c-92d6-9770304fa84d by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:32.869765 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Attempting to bind port 5ea6ecf6-4c90-465c-92d6-9770304fa84d on network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:32.887794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=d0891102-04ad-4704-91ad-cad011c5bb0c,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:32.904745 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:32.907054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:32.908191 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Checking segment: {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:32.908191 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:32.908700 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Bound using segment: {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:32.909310 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Bound port: 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:32.909829 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.092526 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] For port 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:33.097181 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] For port 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5ea6ecf6-4c90-465c-92d6-9770304fa84d,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:33.118092 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683652', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-758997', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1991'] for router, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.157787 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Pushing event updated for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:33.164872 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:33.201495 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Attempting to bind port 916e1087-9c2c-4810-8927-cdee4290b02b on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:33.201910 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Attempting to bind port 916e1087-9c2c-4810-8927-cdee4290b02b by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:33.202261 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Attempting to bind port 916e1087-9c2c-4810-8927-cdee4290b02b on network 424e3c29-adf6-44ca-a36f-5399047a7f0c {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:33.226044 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:33.226370 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Checking segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:33.226875 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.227699 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Bound using segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:33.229210 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Bound port: 916e1087-9c2c-4810-8927-cdee4290b02b, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:33.229577 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.230892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.292287 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.307017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:33.341961 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port e1995789-755d-40e6-abbe-114db4d51d26 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:33.342249 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.413393 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] For port 916e1087-9c2c-4810-8927-cdee4290b02b, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:33.417559 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] For port 916e1087-9c2c-4810-8927-cdee4290b02b, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=916e1087-9c2c-4810-8927-cdee4290b02b,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:33.426839 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.444474 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:33.519786 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:33.520591 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77ebb2e0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:33.553808 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Router 836611e3-0c2b-4441-a32a-e8b7d470c8bc is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98278) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:45:33.570585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f1ca0e-d97c-43dd-8ad3-e633bf08c21d req-8d5f2c75-2481-40b0-b88b-477b160bf514 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:33.570585 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e1f1ca0e-d97c-43dd-8ad3-e633bf08c21d req-8d5f2c75-2481-40b0-b88b-477b160bf514 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.1272779
Jun 02 16:45:33.681392 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.691622 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Pushing event updated for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:33.695859 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Transition to ACTIVE for port object 99e53edd-801f-43ae-b33e-b76333967555 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:33.705579 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:33.744979 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3a4ada7b-0f84-5b6a-a9fd-566ca52601b3-3361e9cb-0a49-460c-b917-d490b80bed43', 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'fixed_ips': [{'subnet_id': '0374350a-1856-4ca5-89da-31ef107805e8'}]}} from dv-cinder-794021-2-iscsi. {{(pid=98279) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 02 16:45:33.745860 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.757357 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e1f1ca0e-d97c-43dd-8ad3-e633bf08c21d req-b7ceafbe-16ce-40c9-8c5e-ec15e114c0d7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1825466
Jun 02 16:45:33.792150 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.872628 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:33.908292 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Notify callbacks [] for router, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.910204 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 3.5033875
Jun 02 16:45:33.913053 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55752) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:33.919616 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Sync routers for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:33.946360 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:33.977791 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:33.987528 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:34.049451 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:34.053831 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c4bb820>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:34.116611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0335a4fe-7f47-421d-9f33-ea81c13de76f req-716edf43-308d-4e10-b54c-f3a5cd6bea52 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:34.118981 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0335a4fe-7f47-421d-9f33-ea81c13de76f req-716edf43-308d-4e10-b54c-f3a5cd6bea52 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.3127027
Jun 02 16:45:34.168684 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:34.169368 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Pushing event updated for resources: {'Port': ['ID=5ea6ecf6-4c90-465c-92d6-9770304fa84d,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:34.312186 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0335a4fe-7f47-421d-9f33-ea81c13de76f req-e15f5749-25d4-4db4-9029-c2503c2183da tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1829944
Jun 02 16:45:34.330962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Allocated IP 172.27.0.15 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/c70570f0-64ed-4a79-a12f-1b21f13eeb3a) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:34.424673 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.118s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:34.430886 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.606s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:34.541926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:34.589407 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:34.596991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-01d97a99-a012-42fe-9efe-eadbcd110975 tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:34.630873 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77ebb2e0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:33Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:34.636383 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd119c1b-360c-4634-af5b-9d240630a5bf None None] The sync data for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi is: [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:33Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:34.678700 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:34.684553 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:34.704521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:34.734283 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:34.776766 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Pushing event updated for resources: {'Port': ['ID=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:34.784231 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:34.822763 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a01f38-9a9a-42a0-aa0c-7eae15ab4731 None None] Pushing event updated for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:34.897907 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-79a01f38-9a9a-42a0-aa0c-7eae15ab4731 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.467s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:34.922934 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Attempting to bind port 99e53edd-801f-43ae-b33e-b76333967555 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:34.923308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Attempting to bind port 99e53edd-801f-43ae-b33e-b76333967555 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:34.923670 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Attempting to bind port 99e53edd-801f-43ae-b33e-b76333967555 on network 51db2abb-3ad8-4a20-b616-e97be139cc03 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:34.986704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:34.987084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Checking segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:34.987496 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:34.987886 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Bound using segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:34.988369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Bound port: 99e53edd-801f-43ae-b33e-b76333967555, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:34.988740 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:35.030112 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.db_base_plugin_common [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Allocated IP 172.20.0.2 (3361e9cb-0a49-460c-b917-d490b80bed43/0374350a-1856-4ca5-89da-31ef107805e8/d45e3628-b1d3-4203-be6b-7095cac5e353) {{(pid=98279) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:35.248541 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5ea6ecf6-4c90-465c-92d6-9770304fa84d up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:35.265349 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab0bce5-95aa-4f4a-99ca-1ad22bcfb6c5 req-0f202051-9436-4e6d-b220-aa4115791438 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:35.273204 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4ab0bce5-95aa-4f4a-99ca-1ad22bcfb6c5 req-0f202051-9436-4e6d-b220-aa4115791438 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.3077350
Jun 02 16:45:35.349072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4ab0bce5-95aa-4f4a-99ca-1ad22bcfb6c5 req-52fc1e59-1f87-4c94-9b8c-400941bed20f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0743918
Jun 02 16:45:35.459466 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:35.465665 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3b7f1d1-36c2-43fa-a22d-07503334ff84 None None] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:35.536070 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:35.638823 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-98242613-e284-433e-944c-d0bdad715687 None None] Provisioning for port 5ea6ecf6-4c90-465c-92d6-9770304fa84d completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:35.644768 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] For port 99e53edd-801f-43ae-b33e-b76333967555, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:35.735100 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Allocated IP 172.20.0.1 (aa8f1ae5-659f-4737-b2e8-7c1e8d416c10/dcde0601-cc3f-44e0-8824-27392d2c697c/15b2b3f2-0370-4a41-82fd-8014da6c2f10) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:35.745277 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] For port 99e53edd-801f-43ae-b33e-b76333967555, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=99e53edd-801f-43ae-b33e-b76333967555,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:35.763896 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-c208afd2-6381-4774-af84-a4f630b78083 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:35.765431 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-c208afd2-6381-4774-af84-a4f630b78083 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.7811804
Jun 02 16:45:35.771099 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:35.783846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-a509188a-6f34-4f78-bfbb-5d3ec48782f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:35.824518 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks [] for port, precommit_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:35.863579 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 5ea6ecf6-4c90-465c-92d6-9770304fa84d completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:35.868347 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Transition to ACTIVE for port object d45e3628-b1d3-4203-be6b-7095cac5e353 will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:35.922913 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5ea6ecf6-4c90-465c-92d6-9770304fa84d triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:35.923698 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.017485 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.050702 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Transition to ACTIVE for port object 15b2b3f2-0370-4a41-82fd-8014da6c2f10 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:36.063360 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Transition to ACTIVE for port object d45e3628-b1d3-4203-be6b-7095cac5e353 will not be triggered until provisioned by entity DHCP. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:36.084289 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:36.084969 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3761f0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:36.090932 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.100156 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:36.180215 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:36.181122 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd077c8-4db8-4f83-9a3f-a17d559cee94 req-a0ae63b9-4f43-4dd9-8d83-e6f56dc07ada tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:36.183108 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dd077c8-4db8-4f83-9a3f-a17d559cee94 req-a0ae63b9-4f43-4dd9-8d83-e6f56dc07ada tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.6497509
Jun 02 16:45:36.195589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:36.198707 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:36.234119 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a01f38-9a9a-42a0-aa0c-7eae15ab4731 None None] Pushing event updated for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:36.252638 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358'] for port, after_create {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.258741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Pushing event updated for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:36.262411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:36.270110 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.296246 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-79a01f38-9a9a-42a0-aa0c-7eae15ab4731 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.512s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:36.296866 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-79a01f38-9a9a-42a0-aa0c-7eae15ab4731 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:36.336008 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9dd077c8-4db8-4f83-9a3f-a17d559cee94 req-14914296-34bf-44c5-823c-699296514833 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1451316
Jun 02 16:45:36.340547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-758988', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683747'] for router, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.394305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Network 3361e9cb-0a49-460c-b917-d490b80bed43 is already hosted by enough agents. {{(pid=98279) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:36.415246 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.428797 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port 14762d04-cafa-47ea-9929-61cd3a540431 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:45:36.429134 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.503434 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.scheduler.base_scheduler [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Resources bound (agent type, host, resource id):  {{(pid=98279) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:36.505994 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Received port after_create {{(pid=98279) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:36.614382 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Pushing event updated for resources: {'Port': ['ID=d45e3628-b1d3-4203-be6b-7095cac5e353,revision_number=1']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:36.617786 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:36.632746 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c4bb820>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 3, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:36.652515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] For port 14762d04-cafa-47ea-9929-61cd3a540431, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=14762d04-cafa-47ea-9929-61cd3a540431,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:36.653133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.695941 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be16f06d-f7ad-4c20-957d-508e73aeb612 req-6f62976e-e484-4b15-bdf7-81790df4e507 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:36.698377 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-be16f06d-f7ad-4c20-957d-508e73aeb612 req-6f62976e-e484-4b15-bdf7-81790df4e507 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 945 time: 0.2023714
Jun 02 16:45:36.699035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:36.762289 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Checking router: 836611e3-0c2b-4441-a32a-e8b7d470c8bc for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:36.762289 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Updating router 836611e3-0c2b-4441-a32a-e8b7d470c8bc port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd binding host dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:36.773235 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-be16f06d-f7ad-4c20-957d-508e73aeb612 req-a0b595ad-632b-40b3-b40f-606b54a2f254 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0579500
Jun 02 16:45:36.794346 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.802859 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.832205 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:36.879966 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Attempting to bind port d45e3628-b1d3-4203-be6b-7095cac5e353 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:36.880772 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Attempting to bind port d45e3628-b1d3-4203-be6b-7095cac5e353 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:36.880994 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd is scheduled to L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 with binding_index 1 {{(pid=98277) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 02 16:45:36.881341 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Attempting to bind port d45e3628-b1d3-4203-be6b-7095cac5e353 on network 3361e9cb-0a49-460c-b917-d490b80bed43 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:36.890832 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.918477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Pushing event updated for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:36.920877 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.924868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:36.988477 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:36.988934 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Checking segment: {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:36.989261 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:36.989686 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Bound using segment: {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:36.990180 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Bound port: d45e3628-b1d3-4203-be6b-7095cac5e353, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:36.990543 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.005187 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.068209 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:37.070792 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:37.128741 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.128741 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.129189 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP 5cb68a72-e093-4e8d-af39-4044762ec487 disassociated. External IP: 172.27.0.114, port: 14762d04-cafa-47ea-9929-61cd3a540431.
Jun 02 16:45:37.129189 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for 14762d04-cafa-47ea-9929-61cd3a540431 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:45:37.180730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:37.190202 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Sync routers for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:37.216045 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:37.216851 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c24a850>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:37.217085 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.222264 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 4.6030977
Jun 02 16:45:37.306233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55766) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:37.409954 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.417953 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90bf8269-8082-4eb6-a2b0-1b4c8cb50096 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:37.480383 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Router 836611e3-0c2b-4441-a32a-e8b7d470c8bc has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:37.482065 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=14762d04-cafa-47ea-9929-61cd3a540431,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:37.493522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:37.563457 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:37.725282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks [] for port, precommit_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:37.787953 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:37.812434 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] 10.222.0.25 "PUT /v2.0/routers/836611e3-0c2b-4441-a32a-e8b7d470c8bc/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.8973379
Jun 02 16:45:37.885976 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5ea6ecf6-4c90-465c-92d6-9770304fa84d,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:37.956072 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Provisioning complete for port 5ea6ecf6-4c90-465c-92d6-9770304fa84d triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:37.956327 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.005904 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Transition to ACTIVE for port object 89b77bd3-6ac4-44af-93e1-19a72b61d5cd will not be triggered until provisioned by entity L2. {{(pid=98279) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:38.025752 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.028175 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d0891102-04ad-4704-91ad-cad011c5bb0c up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:38.062323 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5d31182b-5f8a-4a6a-be33-c95b0bf6e5e0 req-2bea8ac0-dc8e-4cbf-a090-62f5dbd78ac9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 210 time: 0.0778472
Jun 02 16:45:38.078837 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c24a850>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:35Z', 'revision_number': 3, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:38.091772 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Checking router: 14ec93d3-21ec-4da3-9ab3-dbec95f193dd for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:38.092113 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Updating router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd port c70570f0-64ed-4a79-a12f-1b21f13eeb3a binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:38.149898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-cc2605e8-4507-4dab-8517-d0200b7ed065 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:38.181783 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.225223 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.250669 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] For port d45e3628-b1d3-4203-be6b-7095cac5e353, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:38.313105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] For port d45e3628-b1d3-4203-be6b-7095cac5e353, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d45e3628-b1d3-4203-be6b-7095cac5e353,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:38.345589 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e8a549-1909-41ce-9e33-a357f6ed9061 req-59f618de-d9f2-4158-9bc8-6081507a1721 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:38.348469 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d3e8a549-1909-41ce-9e33-a357f6ed9061 req-59f618de-d9f2-4158-9bc8-6081507a1721 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.4577043
Jun 02 16:45:38.390245 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:38.474512 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.490417 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Attempting to bind port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:38.490728 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Attempting to bind port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:38.491203 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Attempting to bind port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:38.502145 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=5ea6ecf6-4c90-465c-92d6-9770304fa84d,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:38.506144 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d3e8a549-1909-41ce-9e33-a357f6ed9061 req-222f1e35-0deb-42ef-a6a2-efaaaa87e27b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1468737
Jun 02 16:45:38.512223 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.363s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:38.512828 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port d0891102-04ad-4704-91ad-cad011c5bb0c triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:38.513199 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.536559 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:38.536937 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98279) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:38.537340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.537757 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98279) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:38.538247 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.managers [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Bound port: 89b77bd3-6ac4-44af-93e1-19a72b61d5cd, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98279) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:38.538621 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.562775 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.321s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:38.714114 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.732143 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Transition to ACTIVE for port object c70570f0-64ed-4a79-a12f-1b21f13eeb3a will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:38.744571 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.758615 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-3e59038e-3b8f-4fe0-851a-ca0afd01f6c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:38.802757 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 14762d04-cafa-47ea-9929-61cd3a540431 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:45:38.829749 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Attempting to bind port c70570f0-64ed-4a79-a12f-1b21f13eeb3a on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:38.830167 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Attempting to bind port c70570f0-64ed-4a79-a12f-1b21f13eeb3a by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:38.830403 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Attempting to bind port c70570f0-64ed-4a79-a12f-1b21f13eeb3a on network 111563ce-426b-47b0-ac88-407bffa30df5 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:38.845587 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:38.846134 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Checking segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:38.846414 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.846523 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c257fa37-e64a-457c-acd7-010f441a6291 None None] Pushing event updated for resources: {'Port': ['ID=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:38.846818 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Bound using segment: {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:38.847595 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Bound port: c70570f0-64ed-4a79-a12f-1b21f13eeb3a, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '234bfbc8-daac-48b7-b048-c18c5c7873a6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:38.847737 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:38.894941 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 14762d04-cafa-47ea-9929-61cd3a540431 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:45:38.895343 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 14762d04-cafa-47ea-9929-61cd3a540431 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:45:38.921822 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] For port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98279) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:38.922044 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:38.945789 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:38.956670 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] For port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:38.990855 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] For port c70570f0-64ed-4a79-a12f-1b21f13eeb3a, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:38.995254 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] For port c70570f0-64ed-4a79-a12f-1b21f13eeb3a, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:39.003155 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Provisioning for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:39.009245 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:39.011714 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:39.032717 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] No DVR routers for this DVR port 14762d04-cafa-47ea-9929-61cd3a540431 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:45:39.037188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:39.040038 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'name': 'network-vif-deleted', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:45:39.042430 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fa1c6ab-7c7c-48be-b6b3-9e6d8a99ea85" -d '{"events": [{"server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "name": "network-vif-deleted", "tag": "14762d04-cafa-47ea-9929-61cd3a540431"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:45:39.048341 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:39.053439 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3761f0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:35Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:39.055640 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:39.056200 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b775ec7c0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:39.073496 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c24a850>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:39.135160 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c997b744-d0ea-4574-b483-22d0032f0cdc req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "DELETE /v2.0/ports/14762d04-cafa-47ea-9929-61cd3a540431 HTTP/1.1" status: 204  len: 173 time: 3.3541265
Jun 02 16:45:39.210787 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Provisioning complete for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:39.211174 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:39.282931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:39.327868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Pushing event updated for resources: {'Port': ['ID=d45e3628-b1d3-4203-be6b-7095cac5e353,revision_number=2']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:39.338742 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531efe31-e178-43aa-b56d-71bd34eadc25 None None] The sync data for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi is: [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:35Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:39.364374 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.802s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:39.365421 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-2b06d569-faa3-45ed-b322-de1b72391606 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.884s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:39.433123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 916e1087-9c2c-4810-8927-cdee4290b02b up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:39.556700 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:39.558109 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c4bb820>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:39.587770 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b13038c8-467c-4f63-800a-4d2698a4641e req-ca77fdee-24cc-431f-88fd-e9e947ed18ea tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:45:39.614588 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:45:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1db79450-e73f-4d65-ba80-9abf460ae880 x-openstack-request-id: req-1db79450-e73f-4d65-ba80-9abf460ae880 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:45:39.614915 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "406de31c-a2b2-4302-a1d3-f45e106b7c7a", "name": "network-vif-deleted", "tag": "14762d04-cafa-47ea-9929-61cd3a540431", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:45:39.615202 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1db79450-e73f-4d65-ba80-9abf460ae880 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:45:39.615631 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '406de31c-a2b2-4302-a1d3-f45e106b7c7a', 'name': 'network-vif-deleted', 'tag': '14762d04-cafa-47ea-9929-61cd3a540431', 'status': 'completed', 'code': 200}
Jun 02 16:45:39.694431 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b13038c8-467c-4f63-800a-4d2698a4641e req-ca77fdee-24cc-431f-88fd-e9e947ed18ea tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:45:39.695628 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b13038c8-467c-4f63-800a-4d2698a4641e req-ca77fdee-24cc-431f-88fd-e9e947ed18ea tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=406de31c-a2b2-4302-a1d3-f45e106b7c7a HTTP/1.1" status: 200  len: 210 time: 0.2133963
Jun 02 16:45:39.708113 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:39.918406 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:39.968634 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Allocated IP 172.20.0.1 (3361e9cb-0a49-460c-b917-d490b80bed43/0374350a-1856-4ca5-89da-31ef107805e8/81617133-7b9e-4431-b711-b9f0f8b88381) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:40.122267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd22b6f-e86f-4a0d-9802-c85179739776 req-795a8ab6-7583-4a04-88f4-cc73dd96dad3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:40.129588 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acd22b6f-e86f-4a0d-9802-c85179739776 req-795a8ab6-7583-4a04-88f4-cc73dd96dad3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.2057881
Jun 02 16:45:40.209273 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab6df68-2f64-4a4c-8f40-be85f8cb3335 None None] Pushing event updated for resources: {'Port': ['ID=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,revision_number=2']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:40.247066 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acd22b6f-e86f-4a0d-9802-c85179739776 req-c3efead6-4f84-489b-8129-f81f26f70577 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1108236
Jun 02 16:45:40.260274 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-5ab6df68-2f64-4a4c-8f40-be85f8cb3335 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.501s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:40.261459 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.235s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:40.278226 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-4f58ec5b-ea70-4f1e-a7f3-c20b83336c3f None None] Port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:40.364088 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab6df68-2f64-4a4c-8f40-be85f8cb3335 None None] Pushing event updated for resources: {'Port': ['ID=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:40.376309 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-5ab6df68-2f64-4a4c-8f40-be85f8cb3335 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:40.408887 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c24a850>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:35Z', 'revision_number': 3, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:40.413547 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-500f6407-d3fa-4a16-9256-2abb73b032d2 None None] The sync data for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi is: [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:35Z', 'revision_number': 3, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:40.426130 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c257fa37-e64a-457c-acd7-010f441a6291 None None] Pushing event updated for resources: {'Port': ['ID=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:40.438040 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-c257fa37-e64a-457c-acd7-010f441a6291 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.072s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:40.451218 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b60a3798-660f-4395-b04d-fb6233670e67 None None] Network 3361e9cb-0a49-460c-b917-d490b80bed43 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:45:40.469499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.437s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:40.470214 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:40.529109 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-88e194d8-31a9-412a-81a2-9bffc55d8fe6 None None] Provisioning for port d45e3628-b1d3-4203-be6b-7095cac5e353 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:40.562658 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 916e1087-9c2c-4810-8927-cdee4290b02b completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:40.574858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 916e1087-9c2c-4810-8927-cdee4290b02b triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:40.575299 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:40.722862 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:40.754800 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Transition to ACTIVE for port object 81617133-7b9e-4431-b711-b9f0f8b88381 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:40.803597 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:40.808636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:40.926754 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Network 3361e9cb-0a49-460c-b917-d490b80bed43 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:40.935303 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:40.954191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:41.010436 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:41.017650 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Pushing event updated for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:41.022843 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:41.067631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-683433'] for router_interface, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.198260 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-88e194d8-31a9-412a-81a2-9bffc55d8fe6 None None] Provisioning complete for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:41.198637 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-88e194d8-31a9-412a-81a2-9bffc55d8fe6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.359241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.370493 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.444797 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-cb9e87d1-4cb1-41af-a330-16dd969fe952 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1074292760&fields=id&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 267 time: 0.1372066
Jun 02 16:45:41.558060 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:45:41.603399 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f28355-0081-4c6a-a28b-ada906c0fd4f req-71973907-c98a-41d8-9729-d6e8a29f6c1d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:41.605461 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-60f28355-0081-4c6a-a28b-ada906c0fd4f req-71973907-c98a-41d8-9729-d6e8a29f6c1d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.1644661
Jun 02 16:45:41.610008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-88e194d8-31a9-412a-81a2-9bffc55d8fe6 None None] Port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:41.720390 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-095d54e4-1fcf-4afc-b5cd-ff39f99a3ead tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:41.721543 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-095d54e4-1fcf-4afc-b5cd-ff39f99a3ead tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:45:41.762134 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-095d54e4-1fcf-4afc-b5cd-ff39f99a3ead tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:45:41.763493 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 916e1087-9c2c-4810-8927-cdee4290b02b, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=916e1087-9c2c-4810-8927-cdee4290b02b,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:41.764154 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-095d54e4-1fcf-4afc-b5cd-ff39f99a3ead tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.3185186
Jun 02 16:45:41.790316 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-9fcfabe5-13d9-4aaf-80d4-0e67ee0a5c98 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/quotas/2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 375 time: 0.0204668
Jun 02 16:45:41.852995 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.886395 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:41.902597 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.915683 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:41.918875 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-bb196bbb-f7cc-4175-b450-bb209e4bb3e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1276629
Jun 02 16:45:41.964130 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a74c8a24-f35e-4490-8952-5bebef0270f1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:42.136865 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-60f28355-0081-4c6a-a28b-ada906c0fd4f req-85cb4923-49dc-4183-ad8b-c674f916ffdc tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.5259778
Jun 02 16:45:42.147547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c4bb820>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '15b2b3f2-0370-4a41-82fd-8014da6c2f10', 'name': '', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'mac_address': 'fa:16:3e:7b:5a:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:35Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 2, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'subnets': [{'id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:42.155366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-535823', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-683468'] for router_interface, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:42.160197 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Pushing event updated for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:42.164903 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:42.180265 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b22bfca2-4f67-4a1a-9102-9e71aa27d1c5 None None] The sync data for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi is: [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '15b2b3f2-0370-4a41-82fd-8014da6c2f10', 'name': '', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'mac_address': 'fa:16:3e:7b:5a:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:35Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 2, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'subnets': [{'id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:42.216325 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:42.231273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:42.246336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b775ec7c0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:42.253257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:42.267336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:42.267676 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b775ec7c0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:42.417714 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5ea6ecf6-4c90-465c-92d6-9770304fa84d up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:42.455789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Network 3361e9cb-0a49-460c-b917-d490b80bed43 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:42.457645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:42.593728 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-3241450b-3894-4323-9636-ad0efb6cea1e service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6520731
Jun 02 16:45:42.842541 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 5ea6ecf6-4c90-465c-92d6-9770304fa84d triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:42.843062 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:42.963576 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:43.024176 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:43.065668 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-756473ed-e29b-4bf1-b9d1-aab8a46f6be0 service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4656539
Jun 02 16:45:43.425387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:45:43.507029 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-82c14858-2e99-4ed2-92b8-4d4b2f17e931 None None] Provisioning for port 81617133-7b9e-4431-b711-b9f0f8b88381 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:43.622794 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-82c14858-2e99-4ed2-92b8-4d4b2f17e931 None None] Provisioning complete for port 81617133-7b9e-4431-b711-b9f0f8b88381 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:43.623898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-82c14858-2e99-4ed2-92b8-4d4b2f17e931 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:43.650958 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:43.698294 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] 10.222.0.25 "PUT /v2.0/routers/14ec93d3-21ec-4da3-9ab3-dbec95f193dd/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.3899269
Jun 02 16:45:43.727904 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae725877-1d2f-44c9-bd8f-f9b0a16e4e1f req-2894ed40-b504-4ae3-9187-fddfe5457761 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:43.729465 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae725877-1d2f-44c9-bd8f-f9b0a16e4e1f req-2894ed40-b504-4ae3-9187-fddfe5457761 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.3116570
Jun 02 16:45:43.870163 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.db.resource_extend [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:45:43.890124 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Sync routers for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:43.918543 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae725877-1d2f-44c9-bd8f-f9b0a16e4e1f req-80303247-0212-424f-b124-d4be04ba31e8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1822314
Jun 02 16:45:43.930319 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:43.932761 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b80005e20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:44.254658 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 99e53edd-801f-43ae-b33e-b76333967555 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:44.378051 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:44.485067 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c53fdbc7-3c7c-4cc8-b2b5-48c4ccf26a62 req-bb56c54a-99f9-441d-95f0-d39ab17399be tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 210 time: 0.1169181
Jun 02 16:45:44.532717 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-82c14858-2e99-4ed2-92b8-4d4b2f17e931 None None] Port 81617133-7b9e-4431-b711-b9f0f8b88381 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:44.876387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55870) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:44.881565 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-562010228', 'description': 'tempest-secgroup-smoke-562010228 description', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:44.890753 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:44.900162 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:44.911282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:44.913464 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:44.921124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:44.941449 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:44.989882 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '94aba472-894e-4275-81c6-19c87819e37c', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:45:45.010534 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 99e53edd-801f-43ae-b33e-b76333967555 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:45.022818 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:45.038107 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:45.041716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:45.058368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:45.107068 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 99e53edd-801f-43ae-b33e-b76333967555 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:45.110047 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.210132 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b80005e20>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 4, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '81617133-7b9e-4431-b711-b9f0f8b88381', 'name': '', 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'mac_address': 'fa:16:3e:12:d2:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 538, 'fixed_ips': [{'subnet_id': '0374350a-1856-4ca5-89da-31ef107805e8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:39Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 2, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'subnets': [{'id': '0374350a-1856-4ca5-89da-31ef107805e8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:45.216441 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Checking router: 14ec93d3-21ec-4da3-9ab3-dbec95f193dd for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:45.216806 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Updating router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd port 81617133-7b9e-4431-b711-b9f0f8b88381 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:45.294104 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.330625 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-7dd3343c-6b25-4f91-ae7b-74699680c8bc None None] Provisioning complete for port 81617133-7b9e-4431-b711-b9f0f8b88381 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:45.333413 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.334204 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-7dd3343c-6b25-4f91-ae7b-74699680c8bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.386177 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.401427 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5f310d10-1a7f-47ac-b567-18fcc84c8fe1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:45.533048 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=15573404-5194-40a3-a9d2-cd9bc27c9c66,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:45.537712 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-7dd3343c-6b25-4f91-ae7b-74699680c8bc None None] Port 81617133-7b9e-4431-b711-b9f0f8b88381 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:45.542666 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:45.544353 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.545229 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.550407 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1ae3ad9a-ef97-4b36-8acd-c4ec4a35ab2c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.6720045
Jun 02 16:45:45.552973 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55880) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:45.558922 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:45.584045 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:45.596926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:45.597176 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd7116d-c60d-49fb-bda4-9ed468df8a2d req-2e6ccd57-d2d0-46a9-9b3b-3d184474c656 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:45.599314 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5cd7116d-c60d-49fb-bda4-9ed468df8a2d req-2e6ccd57-d2d0-46a9-9b3b-3d184474c656 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.4096384
Jun 02 16:45:45.619774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:45.634714 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b775ec7c0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:45.638074 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:45.675901 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7cea0a7-cbaa-408d-aa9f-e6f90ffa12b0 None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:45.696326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.726266 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5cd7116d-c60d-49fb-bda4-9ed468df8a2d req-d1f5216b-5565-4067-b3df-516893c85776 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1146052
Jun 02 16:45:45.740723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:45:45.785116 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:45.844273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:45.853076 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:45.894045 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-43055c47-5d67-4acf-a7f4-b11e5a1171e9 req-f349ce64-8542-40f5-ab59-6f42b2f4f172 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 210 time: 0.1061432
Jun 02 16:45:45.991191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.001711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.006377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f573671f-5ff4-4830-b3da-94c270453c84 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:46.010043 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['94aba472-894e-4275-81c6-19c87819e37c'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:45:46.166529 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.228545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=6']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:46.240952 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:46.280094 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 99e53edd-801f-43ae-b33e-b76333967555, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=99e53edd-801f-43ae-b33e-b76333967555,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:46.297536 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.298879 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d45e3628-b1d3-4203-be6b-7095cac5e353 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:46.326076 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d8ffc5b-9668-4faa-9c08-394d2011b7e0,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:46.339750 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:46.342913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.344213 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.7900939
Jun 02 16:45:46.347248 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55882) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:46.352524 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:46.374745 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:46.391475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:46.393986 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:46.399058 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:46.425351 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:46.455759 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.477008 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Transition to ACTIVE for port object 81617133-7b9e-4431-b711-b9f0f8b88381 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:46.520960 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.528962 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:46.559501 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.639155 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d599b48-f6f8-4b26-8a41-5ea56bf7605a None None] Pushing event updated for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:46.642216 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:46.647052 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-7d599b48-f6f8-4b26-8a41-5ea56bf7605a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:46.650812 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:46.661546 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port d45e3628-b1d3-4203-be6b-7095cac5e353 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:46.691783 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port d45e3628-b1d3-4203-be6b-7095cac5e353 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:46.692234 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.919751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.938550 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:46.943214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:47.091270 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Attempting to bind port 81617133-7b9e-4431-b711-b9f0f8b88381 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:47.091647 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Attempting to bind port 81617133-7b9e-4431-b711-b9f0f8b88381 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:47.092010 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Attempting to bind port 81617133-7b9e-4431-b711-b9f0f8b88381 on network 3361e9cb-0a49-460c-b917-d490b80bed43 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:47.116299 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:47.118171 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Checking segment: {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:47.118639 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.125103 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Bound using segment: {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:47.126341 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.127213 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Bound port: 81617133-7b9e-4431-b711-b9f0f8b88381, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9568214b-a39b-4f26-b48e-a4e73cd5ee69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 699, 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:47.127632 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.245249 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e2d83fd1-aade-4e48-82dc-27db463adab5,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:47.253206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:47.255614 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-fa72a7dd-2340-4703-9ee1-1a69e8c7bcee tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:47.265173 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-fa72a7dd-2340-4703-9ee1-1a69e8c7bcee tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.5900631
Jun 02 16:45:47.268163 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.270071 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.9216857
Jun 02 16:45:47.273125 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55894) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:47.281324 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:47.343563 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port d45e3628-b1d3-4203-be6b-7095cac5e353, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d45e3628-b1d3-4203-be6b-7095cac5e353,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:47.350287 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:47.353192 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.354621 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c70570f0-64ed-4a79-a12f-1b21f13eeb3a up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:47.367316 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:47.388058 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:47.426128 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:47.483477 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] For port 81617133-7b9e-4431-b711-b9f0f8b88381, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:47.493731 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] For port 81617133-7b9e-4431-b711-b9f0f8b88381, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=81617133-7b9e-4431-b711-b9f0f8b88381,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:47.494316 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02540d6-a7a6-43ad-b7d2-b242b7ac713d req-7ea75228-79e1-4fa7-8ccc-861d5b900a85 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:47.509802 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.521507 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:47.525587 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4339fc55-b768-4768-8b53-a1a4668d72ab req-3d308218-f0a3-46ce-bd55-e2a6c0f15394 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 210 time: 0.2552299
Jun 02 16:45:47.525866 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b02540d6-a7a6-43ad-b7d2-b242b7ac713d req-7ea75228-79e1-4fa7-8ccc-861d5b900a85 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 944 time: 0.4931192
Jun 02 16:45:47.532513 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-c9ade807-cd8b-45fb-aafb-0209ce68127e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:47.555663 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-bc8cc2f8-e652-4602-9002-3fdd86f31797 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 380 time: 0.1568253
Jun 02 16:45:47.569731 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'port': {'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'admin_state_up': True, 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'security_groups': ['63174eef-3e33-438d-a435-e3f28b518bec']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:47.646546 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:47.737493 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d599b48-f6f8-4b26-8a41-5ea56bf7605a None None] Pushing event updated for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:47.742195 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-7d599b48-f6f8-4b26-8a41-5ea56bf7605a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:47.761573 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d005a9db-cc4f-42cf-b8e8-6a1dd1060900 None None] New status for floating IP 5cb68a72-e093-4e8d-af39-4044762ec487: DOWN {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:45:47.786011 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:47.786666 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b80005e20>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:47.862305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=d45e3628-b1d3-4203-be6b-7095cac5e353,revision_number=3']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:47.867451 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b02540d6-a7a6-43ad-b7d2-b242b7ac713d req-2887528c-4c0a-4454-9579-a4fdd909d6ad tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3402615
Jun 02 16:45:47.874939 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:47.892901 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:48.070339 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Sync routers for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:48.087077 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.096937 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port c70570f0-64ed-4a79-a12f-1b21f13eeb3a completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:48.106262 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.108956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c15ebf55-bcc8-4d9b-a2b5-fde766da2300 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:48.132122 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port c70570f0-64ed-4a79-a12f-1b21f13eeb3a triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:48.133098 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.181515 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:48.196511 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cc92a00>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:48.222948 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:48.232184 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b13a7082-ae50-4d3c-a640-eb20ca0d30ed,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:48.235486 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:48.252788 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:48.268114 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.270204 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.9941037
Jun 02 16:45:48.273991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55898) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:48.290200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:48.318597 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:48.346374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Made reservation on behalf of 2be2419a57e644b38a5c0ca942660a19 for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:45:48.350194 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.395051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:48.416486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:48.452454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:48.673930 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 94aba472-894e-4275-81c6-19c87819e37c triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:48.674326 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:48.728352 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:48.837798 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:48.940187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.20.0.11 (00fea91a-5ad9-4ee8-ae53-59f9858b59ca/ca8cd98d-c3e8-45ac-8780-59a7fe077750/fb1aaf42-cb49-4b75-8a08-00c10908c38a) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:45:48.941369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.014904 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b348e71a-3a66-4198-94ca-12c058ec497d req-5fec77ff-cf12-451c-bebd-294cd15d59cd tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 210 time: 0.1172285
Jun 02 16:45:49.016868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port c70570f0-64ed-4a79-a12f-1b21f13eeb3a, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:49.038186 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.048111 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:49.412886 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.441280 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 89b77bd3-6ac4-44af-93e1-19a72b61d5cd up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:49.644442 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:49.698390 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.711482 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.664s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:49.718991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.742633 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.767986 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.792069 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:45:49.795195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-611c1e34-aaac-4686-8b4f-33adcf0e81e8" -d '{"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:45:49.798278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14fffc4-4d9b-4ea9-b62a-0b74f5911a1b req-b98461e1-325f-4878-8583-283e72c14d09 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:49.804433 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c14fffc4-4d9b-4ea9-b62a-0b74f5911a1b req-b98461e1-325f-4878-8583-283e72c14d09 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 944 time: 0.4655790
Jun 02 16:45:49.807923 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:49.823466 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.834776 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Transition to ACTIVE for port object fb1aaf42-cb49-4b75-8a08-00c10908c38a will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:49.836774 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:49.884083 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:49.909447 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c14fffc4-4d9b-4ea9-b62a-0b74f5911a1b req-50b3c999-572f-48c0-9fc7-622a30596b60 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0988154
Jun 02 16:45:49.909917 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:49.915168 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 1.6389549
Jun 02 16:45:49.915912 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55912) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:49.928291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=edea9441-4684-4031-83ba-a0ede55acabb,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:49.933246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ba13413b-778c-42cb-8431-7598e39a0846 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:49.940937 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:49.952982 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:49.969851 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23431b1b-3af8-4d11-8ceb-471d9db7e7c4 req-b7f77510-d46a-4449-806f-dd7c539695af tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:49.971936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:49.976773 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23431b1b-3af8-4d11-8ceb-471d9db7e7c4 req-b7f77510-d46a-4449-806f-dd7c539695af tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.4246356
Jun 02 16:45:49.983959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:49.996875 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:50.014958 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:50.021860 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:50.022273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.047371 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.securitygroups_db [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Project b110174a94dd4df89cc6dc7b34bb7170 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:45:50.057953 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.087394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.113956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9e058500-4a11-4c17-90b4-be17b17696e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:50.193518 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.203736 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.206683 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4f0e4762-1e47-4782-a39c-2a9843854196 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:50.213147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:45:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f25f8b27-b62f-46e8-b8e6-195f2d76f338 x-openstack-request-id: req-f25f8b27-b62f-46e8-b8e6-195f2d76f338 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:45:50.213439 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:45:50.213811 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f25f8b27-b62f-46e8-b8e6-195f2d76f338 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:45:50.214126 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'code': 200}
Jun 02 16:45:50.259539 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1737e1e5-f131-46d3-bce9-ed73877e8309,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:50.264670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:50.270486 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.277273 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-fecc84ea-a43c-42c9-8f79-47b2ecf1b9a2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3598957
Jun 02 16:45:50.278102 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55918) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:50.283386 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'security_group_rule': {'security_group_id': '15573404-5194-40a3-a9d2-cd9bc27c9c66', 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:50.291441 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:45:50.292449 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23431b1b-3af8-4d11-8ceb-471d9db7e7c4 req-55ad1750-dfac-4c09-bd8d-3778a76e0fb4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3011336
Jun 02 16:45:50.297516 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:security_group_rule and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:45:50.309761 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:45:50.309761 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:45:50.319240 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cc92a00>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '15b2b3f2-0370-4a41-82fd-8014da6c2f10', 'name': '', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'mac_address': 'fa:16:3e:7b:5a:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:35Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 2, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'subnets': [{'id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:50.321190 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=7']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:50.326232 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.489s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:50.327848 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.securitygroups_db [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Project b110174a94dd4df89cc6dc7b34bb7170 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:45:50.338322 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:45:50.343039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:45:50.343882 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.353204 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b80005e20>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 4, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '81617133-7b9e-4431-b711-b9f0f8b88381', 'name': '', 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'mac_address': 'fa:16:3e:12:d2:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 538, 'fixed_ips': [{'subnet_id': '0374350a-1856-4ca5-89da-31ef107805e8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:39Z', 'updated_at': '2021-06-02T16:45:47Z', 'revision_number': 4, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'subnets': [{'id': '0374350a-1856-4ca5-89da-31ef107805e8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:50.359414 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Checking router: 836611e3-0c2b-4441-a32a-e8b7d470c8bc for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:50.359953 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Updating router 836611e3-0c2b-4441-a32a-e8b7d470c8bc port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 binding host dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 02 16:45:50.361980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:45:50.480650 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:50.488502 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:50.499291 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.502799 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.520269 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c800be50-4be9-4234-8f88-96968c9231d3 None None] The sync data for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi is: [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 4, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '81617133-7b9e-4431-b711-b9f0f8b88381', 'name': '', 'network_id': '3361e9cb-0a49-460c-b917-d490b80bed43', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'mac_address': 'fa:16:3e:12:d2:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 538, 'fixed_ips': [{'subnet_id': '0374350a-1856-4ca5-89da-31ef107805e8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:39Z', 'updated_at': '2021-06-02T16:45:47Z', 'revision_number': 4, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'subnets': [{'id': '0374350a-1856-4ca5-89da-31ef107805e8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:50.546112 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:50.552275 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.553880 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 99e53edd-801f-43ae-b33e-b76333967555 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:50.578353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:50.579840 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.658921 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.0963109
Jun 02 16:45:50.682311 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Request body: {'port': {'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:45:50.687553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:50.850947 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.879459 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.904925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c75ae023-0712-4816-afa1-73da6c338ce1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:50.926353 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 99e53edd-801f-43ae-b33e-b76333967555 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:50.926677 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:50.982512 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c421f25-6072-4bd8-85b5-a74ad2d31b1f req-c7144bf8-da78-4647-8a67-16d7f3fef15a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:50.997225 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c421f25-6072-4bd8-85b5-a74ad2d31b1f req-c7144bf8-da78-4647-8a67-16d7f3fef15a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 932 time: 0.5061052
Jun 02 16:45:51.054757 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ddc792fa-988f-4cb7-a44b-d17914456ec9,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:51.073009 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:51.087617 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.089709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.093598 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-f6c322b3-4422-410b-afc9-6ee08f1b5878 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.8144152
Jun 02 16:45:51.159684 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9a47a08a-0967-49a4-9624-581611045736 None None] Provisioning for port fb1aaf42-cb49-4b75-8a08-00c10908c38a completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:51.255951 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9a47a08a-0967-49a4-9624-581611045736 None None] Provisioning complete for port fb1aaf42-cb49-4b75-8a08-00c10908c38a triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:51.256650 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9a47a08a-0967-49a4-9624-581611045736 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.297820 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d45e3628-b1d3-4203-be6b-7095cac5e353 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:51.321221 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c421f25-6072-4bd8-85b5-a74ad2d31b1f req-c5c59027-e526-4743-bba4-713bec86da7c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3226969
Jun 02 16:45:51.381067 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:51.397499 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.710s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:51.444325 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port d45e3628-b1d3-4203-be6b-7095cac5e353 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:51.444969 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.515639 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks [] for port, precommit_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.524621 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-9a47a08a-0967-49a4-9624-581611045736 None None] Port fb1aaf42-cb49-4b75-8a08-00c10908c38a cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:45:51.530670 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-d430b6b6-b872-4e28-be90-0b29991ef37f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:51.539980 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-d430b6b6-b872-4e28-be90-0b29991ef37f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.3854265
Jun 02 16:45:51.543261 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.provisioning_blocks [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Transition to ACTIVE for port object 15b2b3f2-0370-4a41-82fd-8014da6c2f10 will not be triggered until provisioned by entity L2. {{(pid=98280) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:51.559966 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:51.565702 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-a0b51a8e-608c-4e97-b3c2-95bb467c97d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:51.913701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05170bc5-8bbd-4c4f-a024-9ed1111499dd req-7de1ef4e-06ed-4e47-9a62-e56f3c3c50b8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:51.921241 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05170bc5-8bbd-4c4f-a024-9ed1111499dd req-7de1ef4e-06ed-4e47-9a62-e56f3c3c50b8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.5963991
Jun 02 16:45:51.926589 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 916e1087-9c2c-4810-8927-cdee4290b02b up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:52.066365 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05170bc5-8bbd-4c4f-a024-9ed1111499dd req-06913ea0-3979-4068-97ed-b73bc87cf412 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1435342
Jun 02 16:45:52.142646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1daa17-b6f9-4839-b77e-df30a630006e req-4526b4a9-81bb-4af9-aa35-ec94b0b34371 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:52.150403 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e1daa17-b6f9-4839-b77e-df30a630006e req-4526b4a9-81bb-4af9-aa35-ec94b0b34371 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 945 time: 0.4809647
Jun 02 16:45:52.200294 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c34d568-78fd-40e4-832e-3c0513fb31a3 None None] Pushing event updated for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=3']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:52.219688 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-7c34d568-78fd-40e4-832e-3c0513fb31a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.654s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:52.229890 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 916e1087-9c2c-4810-8927-cdee4290b02b triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:52.230529 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.262659 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8e1daa17-b6f9-4839-b77e-df30a630006e req-a39b2b1a-343c-419a-9235-118ffc087feb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=82ded133-9206-48c1-9cff-f5d790937039&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1111181
Jun 02 16:45:52.280480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Deleting port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:45:52.283196 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.395882 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Attempting to bind port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 on host dv-cinder-794021-2-iscsi for vnic_type normal with profile  {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:52.401571 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Attempting to bind port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 by drivers openvswitch,hyperv on host dv-cinder-794021-2-iscsi at level 0 using segments [{'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:52.403536 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Attempting to bind port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 on network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:52.428513 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Checking agent: {'id': 'b51b2e03-f886-4ded-bffe-1edfe52dffb5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-794021-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 31, 59), 'started_at': datetime.datetime(2021, 6, 2, 16, 32, 29), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-794021-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:52.429236 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Checking segment: {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98280) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:52.432322 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.432947 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Bound using segment: {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'} {{(pid=98280) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:52.433635 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.managers [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Bound port: 15b2b3f2-0370-4a41-82fd-8014da6c2f10, host: dv-cinder-794021-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b95ee089-a680-4b57-bb97-869ed2123671', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 694, 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10'}}] {{(pid=98280) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:52.438539 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.459043 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fb1aaf42-cb49-4b75-8a08-00c10908c38a {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:45:52.494038 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.559062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Transition to ACTIVE for port object fb1aaf42-cb49-4b75-8a08-00c10908c38a will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:45:52.567682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.580306 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-eedba18e-e466-4f9f-b159-98e7ffec6d71 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:52.697462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] For port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:52.697867 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.848408 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] For port 15b2b3f2-0370-4a41-82fd-8014da6c2f10, host dv-cinder-794021-2-iscsi, cleared binding levels {{(pid=98280) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:52.857468 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.plugins.ml2.db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] For port 15b2b3f2-0370-4a41-82fd-8014da6c2f10, host dv-cinder-794021-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=15b2b3f2-0370-4a41-82fd-8014da6c2f10,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98280) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:52.865572 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron_lib.callbacks.manager [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98280) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:52.870750 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-d3df0a3a-7cff-4d81-87c5-e72f3fff12f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:53.183406 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 81617133-7b9e-4431-b711-b9f0f8b88381 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:53.185751 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c34d568-78fd-40e4-832e-3c0513fb31a3 None None] Pushing event updated for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=4']} {{(pid=98280) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:53.195688 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG oslo_concurrency.lockutils [None req-7c34d568-78fd-40e4-832e-3c0513fb31a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=98280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:53.201339 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:53.207555 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cc92a00>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:53.440424 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 81617133-7b9e-4431-b711-b9f0f8b88381 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:53.446227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 81617133-7b9e-4431-b711-b9f0f8b88381 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:53.446613 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:53.629724 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Pushing event updated for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:53.644747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.064s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:53.678136 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:53.765643 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:53.771615 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:53.772646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:53.772646 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Floating IP 453ca265-eca3-45c8-8852-538cc3de6dee disassociated. External IP: 172.27.0.177, port: 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8.
Jun 02 16:45:53.772646 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Calling delete_port for 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:45:53.846542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Attempting to bind port fb1aaf42-cb49-4b75-8a08-00c10908c38a on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:45:53.846881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Attempting to bind port fb1aaf42-cb49-4b75-8a08-00c10908c38a by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:45:53.847216 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Attempting to bind port fb1aaf42-cb49-4b75-8a08-00c10908c38a on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:53.863519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61a09df-4b34-489f-8ad5-bd1039f3cc09 req-4bf06dda-d196-4a92-aec3-a0647e59dfd1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:53.864320 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f61a09df-4b34-489f-8ad5-bd1039f3cc09 req-4bf06dda-d196-4a92-aec3-a0647e59dfd1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:45:53.874779 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Port fb1aaf42-cb49-4b75-8a08-00c10908c38a on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:45:53.875399 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Attempting to bind port fb1aaf42-cb49-4b75-8a08-00c10908c38a on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:45:53.895153 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 81617133-7b9e-4431-b711-b9f0f8b88381, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=81617133-7b9e-4431-b711-b9f0f8b88381,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:53.929895 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:45:53.941813 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3548e958-1cf8-44ce-bd8d-21736da3590c req-cb06035f-d057-4408-b3ac-e205bd1438ab tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:53.948886 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3548e958-1cf8-44ce-bd8d-21736da3590c req-cb06035f-d057-4408-b3ac-e205bd1438ab tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.4433377
Jun 02 16:45:53.975423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 45, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:45:53.975765 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:45:53.976165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Bound using segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:45:53.976618 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Bound port: fb1aaf42-cb49-4b75-8a08-00c10908c38a, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:45:53.976975 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.151981 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.154142 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c70570f0-64ed-4a79-a12f-1b21f13eeb3a up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:54.157539 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3548e958-1cf8-44ce-bd8d-21736da3590c req-48c91218-8d53-42d2-afb4-0215e14df058 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1819265
Jun 02 16:45:54.181675 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cc92a00>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '15b2b3f2-0370-4a41-82fd-8014da6c2f10', 'name': '', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'mac_address': 'fa:16:3e:7b:5a:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:35Z', 'updated_at': '2021-06-02T16:45:52Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'subnets': [{'id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:54.188122 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1402fd-10aa-4a2e-a421-e64f5e362ecd None None] The sync data for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi is: [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:45:36Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '15b2b3f2-0370-4a41-82fd-8014da6c2f10', 'name': '', 'network_id': 'aa8f1ae5-659f-4737-b2e8-7c1e8d416c10', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'mac_address': 'fa:16:3e:7b:5a:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:35Z', 'updated_at': '2021-06-02T16:45:52Z', 'revision_number': 4, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'subnets': [{'id': 'dcde0601-cc3f-44e0-8824-27392d2c697c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:54.232304 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:54.306941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:45:54.318483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:45:54.331138 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.345521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6fd9333d-a3f9-45cc-8dfb-353a6ad237b1 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:54.362387 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.373172 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-bf881234-d7e6-47d9-a51a-a35b1cb7f0bb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:54.404123 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No ports have port_id starting with 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8
Jun 02 16:45:54.436389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-f61a09df-4b34-489f-8ad5-bd1039f3cc09 req-4bf06dda-d196-4a92-aec3-a0647e59dfd1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:45:54.437728 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f61a09df-4b34-489f-8ad5-bd1039f3cc09 req-4bf06dda-d196-4a92-aec3-a0647e59dfd1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 1.7615883
Jun 02 16:45:54.490323 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:54.496238 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:54.510170 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port c70570f0-64ed-4a79-a12f-1b21f13eeb3a triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:54.511987 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.559355 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'Port': ['ID=9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:54.570099 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:54.609304 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-41ed7a67-6279-498e-adfa-841b675109b1 req-8fef7cbc-8c29-430c-803c-096fd7ac9b07 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 210 time: 0.1066108
Jun 02 16:45:54.642894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:54.645001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:54.652035 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] 10.222.0.20 "PUT /v2.0/ports/fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 1094 time: 3.9845135
Jun 02 16:45:54.686545 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f61a09df-4b34-489f-8ad5-bd1039f3cc09 req-416d960d-77b6-4c9f-a177-02d265418746 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2221196
Jun 02 16:45:54.691215 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:45:54.693598 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-972d485d-40b3-4d97-938c-0fece7e220e2" -d '{"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:45:54.823369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Pushing event updated for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:54.837955 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.492s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:54.856502 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-ef54a049-3db1-4fd3-b413-ca7f70022d69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:54.874023 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-ef54a049-3db1-4fd3-b413-ca7f70022d69 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1097 time: 0.1582565
Jun 02 16:45:55.021393 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 89b77bd3-6ac4-44af-93e1-19a72b61d5cd up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:55.023814 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:45:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-893240b9-b7ba-427f-bfaa-848bb57c5f91 x-openstack-request-id: req-893240b9-b7ba-427f-bfaa-848bb57c5f91 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:45:55.024348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:45:55.025069 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-893240b9-b7ba-427f-bfaa-848bb57c5f91 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:45:55.025678 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'status': 'completed', 'code': 200}
Jun 02 16:45:55.049452 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-e748d1e5-5f04-41ca-ad75-a7f4d92dcef1 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 217 time: 0.1674490
Jun 02 16:45:55.191390 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:45:55.206189 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-aa6f8193-3ed9-46eb-9c40-00d20668bd12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:55.209745 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-aa6f8193-3ed9-46eb-9c40-00d20668bd12 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.1526265
Jun 02 16:45:55.262598 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:55.262981 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:55.348342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-31aa7adf-0404-481e-a4da-e252490b64b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:55.357774 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-31aa7adf-0404-481e-a4da-e252490b64b8 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1406009
Jun 02 16:45:55.803372 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-119f538b-6f24-4fc5-9907-cd1f844af52b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:55.864510 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-7dfc35ed-b4f9-4cd0-8bfb-94596e0a8ce9 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4988060
Jun 02 16:45:55.881001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b23c88a-f6f2-4fb7-9694-78a0715d84f2 req-fb203af7-7ec3-42b7-b4bc-465ae38de8dc tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:55.882754 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b23c88a-f6f2-4fb7-9694-78a0715d84f2 req-fb203af7-7ec3-42b7-b4bc-465ae38de8dc tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.2481241
Jun 02 16:45:55.922140 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 81617133-7b9e-4431-b711-b9f0f8b88381 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:56.019161 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 81617133-7b9e-4431-b711-b9f0f8b88381 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:56.019448 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:56.077980 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b23c88a-f6f2-4fb7-9694-78a0715d84f2 req-160cd8a4-6869-4363-9652-ad4b9e34ef4e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1723945
Jun 02 16:45:56.166523 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b00cbd4b-3e7a-4b4c-a73c-5ac10f9a2a87 req-7f4313bb-b498-49c6-a4b7-c3cf4a05dece service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2826765
Jun 02 16:45:56.202300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:45:56.284749 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:45:56.367521 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 15b2b3f2-0370-4a41-82fd-8014da6c2f10 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:56.465724 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:56.467284 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b774cb790>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:56.504478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] No DVR routers for this DVR port 9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:45:56.511338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:56.532224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-e1d6bfd9-1b0f-4bf6-964f-8062774e6010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:56.533816 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-e1d6bfd9-1b0f-4bf6-964f-8062774e6010 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1097 time: 0.3092279
Jun 02 16:45:56.534326 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'name': 'network-vif-deleted', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:45:56.546228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b838edb6-d8ae-4a30-a185-f8137c4631aa" -d '{"events": [{"server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "name": "network-vif-deleted", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:45:56.582271 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f0e5fba9-665c-4e9d-aa91-b66c1741022c req-26c38618-084b-4c2a-a5fd-adb57cbd7640 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=47f28cbe-45c6-41c5-9f82-a225a1f8a7b1 HTTP/1.1" status: 200  len: 210 time: 0.2712746
Jun 02 16:45:56.596421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631a04b6-5557-4cdb-b4b9-70fb68f85fbc req-bbff58a3-cf57-47d3-83f0-da2b49188847 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:56.601063 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e6fb52af-f6c8-4459-aa0f-cdd7f4beb753 req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "DELETE /v2.0/ports/9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8 HTTP/1.1" status: 204  len: 173 time: 5.0512383
Jun 02 16:45:56.609111 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-631a04b6-5557-4cdb-b4b9-70fb68f85fbc req-bbff58a3-cf57-47d3-83f0-da2b49188847 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 0.2039037
Jun 02 16:45:56.695802 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:45:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84be2e03-bd4c-4a08-a881-05a198a4d4d5 x-openstack-request-id: req-84be2e03-bd4c-4a08-a881-05a198a4d4d5 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:45:56.696126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47f28cbe-45c6-41c5-9f82-a225a1f8a7b1", "name": "network-vif-deleted", "tag": "9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:45:56.696420 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-84be2e03-bd4c-4a08-a881-05a198a4d4d5 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:45:56.696850 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47f28cbe-45c6-41c5-9f82-a225a1f8a7b1', 'name': 'network-vif-deleted', 'tag': '9e19bfc4-9c9a-4b3a-92f7-52777ae5cdb8', 'status': 'completed', 'code': 200}
Jun 02 16:45:56.730107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:56.873100 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-631a04b6-5557-4cdb-b4b9-70fb68f85fbc req-b3ab7c14-5dec-471c-9774-db40d06b63ca tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2625384
Jun 02 16:45:56.966451 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-da638c09-0f17-41fc-9298-9ff043d52d8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:56.975419 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-da638c09-0f17-41fc-9298-9ff043d52d8f service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.4322867
Jun 02 16:45:56.999453 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:45:57.009749 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:57.010136 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:57.256149 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:57.305857 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] For port 15b2b3f2-0370-4a41-82fd-8014da6c2f10, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=15b2b3f2-0370-4a41-82fd-8014da6c2f10,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:45:57.318704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:57.330079 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:57.433968 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Pushing event updated for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:57.465633 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b774cb790>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:57.481309 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:57.483703 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:45:57.512949 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-bc9f8883-212e-43e5-b6ef-79665f15d028 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 217 time: 0.5277419
Jun 02 16:45:57.523159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:45:57.523934 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b774cb790>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:57.626960 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b44fdce-6f7b-4d1d-8491-e07c61f5cd61 req-319d333a-b6e7-475c-a789-0c781b624a79 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:57.645183 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7b44fdce-6f7b-4d1d-8491-e07c61f5cd61 req-319d333a-b6e7-475c-a789-0c781b624a79 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.2944453
Jun 02 16:45:57.682406 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-4e41b5f9-31c8-4395-979c-a446ca9f9747 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:57.683744 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-4e41b5f9-31c8-4395-979c-a446ca9f9747 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.1620660
Jun 02 16:45:57.799110 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7b44fdce-6f7b-4d1d-8491-e07c61f5cd61 req-c7509367-3818-47fc-9029-4d2055360329 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1457596
Jun 02 16:45:57.846042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 15b2b3f2-0370-4a41-82fd-8014da6c2f10 up at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:45:57.850854 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55968) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:57.858276 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-12c70aab-591e-4773-b6c1-4852c69fd3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:57.859926 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-12c70aab-591e-4773-b6c1-4852c69fd3c0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1682193
Jun 02 16:45:58.002174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.117633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.155764 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-dc88957c-3ea2-465d-8f1d-c1e041016663 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2873185
Jun 02 16:45:58.200267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4698db01-3aa6-435e-861d-f72dbb651226 req-dc1857e8-7482-4406-9c38-92b5268fba02 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:58.213998 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4698db01-3aa6-435e-861d-f72dbb651226 req-dc1857e8-7482-4406-9c38-92b5268fba02 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 0.1890049
Jun 02 16:45:58.220329 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Provisioning complete for port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:45:58.220329 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.337624 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4698db01-3aa6-435e-861d-f72dbb651226 req-5d29bf28-d5d8-4df7-ab48-9a69696e4d92 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1200454
Jun 02 16:45:58.340500 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.345073 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a4afddf5-2fab-4d72-9efc-2fbc1b90baeb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:45:58.398937 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82ded133-9206-48c1-9cff-f5d790937039,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:45:58.425713 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.426893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.427771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.428988 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.429481 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.429978 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.430444 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.430882 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.431343 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.431797 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.432502 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:45:58.433012 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.433488 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:45:58.445811 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:45:58.459167 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.460506 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "DELETE /v2.0/security-groups/82ded133-9206-48c1-9cff-f5d790937039 HTTP/1.1" status: 204  len: 168 time: 0.6084042
Jun 02 16:45:58.463335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55972) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:58.499618 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.api.v2.resource [None req-e96d87a7-c327-492e-b23f-2b9ecb6eeb36 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] show failed (client error): The resource could not be found.
Jun 02 16:45:58.501123 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e96d87a7-c327-492e-b23f-2b9ecb6eeb36 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups/82ded133-9206-48c1-9cff-f5d790937039 HTTP/1.1" status: 404  len: 347 time: 0.0366793
Jun 02 16:45:58.508829 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 55974) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:45:58.540781 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-972d485d-40b3-4d97-938c-0fece7e220e2 req-18e7879c-6eca-4136-b46f-f0525f9e28b0 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3783076
Jun 02 16:45:58.913050 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3612e7c8-1ac2-474f-9a98-a404641907fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.922387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:58.938850 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Deleting port 62d6149c-1b83-4c35-aa6e-01aa6947347a {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:45:58.939489 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:59.132604 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:59.135622 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:59.235518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d969873d-fea8-4dd6-a07b-608289fbd71e req-ccf2c921-2711-42ab-b344-31acac54e821 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:45:59.237129 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d969873d-fea8-4dd6-a07b-608289fbd71e req-ccf2c921-2711-42ab-b344-31acac54e821 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.1959071
Jun 02 16:45:59.338979 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d969873d-fea8-4dd6-a07b-608289fbd71e req-fa0660f8-09b5-4bbc-a1c5-28a4ede0ecec tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0954697
Jun 02 16:45:59.417723 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Calling delete_port for 62d6149c-1b83-4c35-aa6e-01aa6947347a owned by network:floatingip {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:45:59.512196 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b774cb790>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:45:59.543307 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46f494a-890c-4efc-a6b5-cbe271c2e86e None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:45:59.805498 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:45:59.830036 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-3a5a9760-60a3-4c17-9293-ad4122956819 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:00.022452 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'Port': ['ID=62d6149c-1b83-4c35-aa6e-01aa6947347a,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:00.048318 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b585fc72-4a5e-4836-9d2f-0545613328cf req-89cb82af-c789-4c04-9615-9586dcf22d0c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:00.050002 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b585fc72-4a5e-4836-9d2f-0545613328cf req-89cb82af-c789-4c04-9615-9586dcf22d0c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 0.4707394
Jun 02 16:46:00.126331 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:00.163660 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b585fc72-4a5e-4836-9d2f-0545613328cf req-88bcb877-cdad-4294-9fe1-1ef431d3c796 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0790153
Jun 02 16:46:00.191389 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:00.201079 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a011038-db3b-4d69-b2bc-8129e6565249 None None] New status for floating IP 453ca265-eca3-45c8-8852-538cc3de6dee: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:46:00.230877 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:00.246519 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "DELETE /v2.0/floatingips/453ca265-eca3-45c8-8852-538cc3de6dee HTTP/1.1" status: 204  len: 168 time: 1.7244236
Jun 02 16:46:00.255070 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:00.718769 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55988) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:00.724392 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group': {'name': 'tempest-securitygroup--305634712', 'description': 'tempest-description--890173828'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:00.736063 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:00.752979 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:00.761633 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:00.779551 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:00.811824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:00.848331 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:00.853322 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:00.856636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:00.863705 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:00.919193 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14c0cd7-e96b-4158-90ad-652972f8dea3 req-34bcd1cd-d531-4771-a223-c143ac7fecaa tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:00.924151 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d14c0cd7-e96b-4158-90ad-652972f8dea3 req-34bcd1cd-d531-4771-a223-c143ac7fecaa tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.3201401
Jun 02 16:46:00.957585 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:00.962383 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.007609 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d14c0cd7-e96b-4158-90ad-652972f8dea3 req-ef21d05e-87c2-49e6-aa75-56c70096574b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0761633
Jun 02 16:46:01.023898 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-43c4114d-7e12-4beb-af37-bced50d44cfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:01.041459 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.042779 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.3223798
Jun 02 16:46:01.045869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 55990) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:01.057168 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group_rule': {'security_group_id': 'dd9e62fc-8b34-4a3f-8e16-bffb722741af', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:01.070177 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:01.076662 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:01.079753 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:01.089480 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:01.096387 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dd9e62fc-8b34-4a3f-8e16-bffb722741af,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:01.100729 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:01.112508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.205398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.211873 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.214292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a237af86-767d-4256-b1e1-9f6d8ce369e1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:01.242688 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2a9c0890-1c70-451a-9378-b66a53bcdb75,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:01.245551 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:01.254800 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.258143 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2112038
Jun 02 16:46:01.259204 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56000) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:01.265701 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'security_group_rule': {'security_group_id': 'dd9e62fc-8b34-4a3f-8e16-bffb722741af', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:01.273225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:01.278432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:security_group_rule and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:01.282576 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:01.294911 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:01.324281 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.484948 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.495708 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.500991 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:01.529435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7c9cdae-77f6-4a5b-9d43-786558e1a994,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:01.534870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:01.553102 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.558046 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56028) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:01.560303 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b820ef7c-0b3a-4a2f-8416-2d72c4aa5928 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2997169
Jun 02 16:46:01.564362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:01.573521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:01.579455 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Usage tracker for resource:floatingip and tenant:5febf86d75284ccb9dac5e0dadffd715 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:01.584131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:01.593189 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:01.608382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a6aef9-e22c-4fcf-a878-f159ea8cea52 req-0e8f2ccf-25a5-49b5-b0fc-f5579ae41179 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:01.610396 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-47a6aef9-e22c-4fcf-a878-f159ea8cea52 req-0e8f2ccf-25a5-49b5-b0fc-f5579ae41179 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 0.1791244
Jun 02 16:46:01.620007 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.734513 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-47a6aef9-e22c-4fcf-a878-f159ea8cea52 req-284c72fd-a08d-487e-9b3b-151f5dd01d93 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0952377
Jun 02 16:46:01.863553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:01.887659 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:02.235656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-deded8f3-e88b-4102-940d-76cf9a7dc5f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:02.237219 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-deded8f3-e88b-4102-940d-76cf9a7dc5f4 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1098 time: 0.2380407
Jun 02 16:46:02.246096 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Allocated IP 172.27.0.190 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/a3702686-f2bf-414e-9a98-c379dcefb29f) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:02.417386 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397b4a1b-338b-463a-993e-5a6f2baa683e req-28ca468f-9576-4e3e-883a-742f3da0043d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:02.417386 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-397b4a1b-338b-463a-993e-5a6f2baa683e req-28ca468f-9576-4e3e-883a-742f3da0043d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.2611918
Jun 02 16:46:02.619195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-b97e8283-2519-4a8d-8d7e-8959eac2006d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:02.621520 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-b97e8283-2519-4a8d-8d7e-8959eac2006d service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.3609879
Jun 02 16:46:02.633871 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-397b4a1b-338b-463a-993e-5a6f2baa683e req-7c3a2a78-f0f3-45fc-abd7-2b8d223c55af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2050259
Jun 02 16:46:02.717329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:02.765156 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-4e3a7d01-cd3a-4fbe-9ff6-0d5d11baeceb service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 1000 time: 0.1269636
Jun 02 16:46:02.983573 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-b82ae916-67b0-40de-99da-1c475ded9f29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:02.987664 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-b82ae916-67b0-40de-99da-1c475ded9f29 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.2131433
Jun 02 16:46:03.002227 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:03.025694 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d6b8ea-b4c9-46d0-acf6-672b716ecdd6 req-5419beec-1b4e-493c-a612-101e989ab3c4 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:03.028056 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-37d6b8ea-b4c9-46d0-acf6-672b716ecdd6 req-5419beec-1b4e-493c-a612-101e989ab3c4 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 944 time: 0.1323121
Jun 02 16:46:03.039626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-900133de-326c-4076-a787-47b4f354f5f3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:03.083712 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-37d6b8ea-b4c9-46d0-acf6-672b716ecdd6 req-8e5ae72b-4910-4090-b0f0-780e49bfa6ba tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0471725
Jun 02 16:46:03.110837 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:03.119344 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:03.125082 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:03.167322 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=a3702686-f2bf-414e-9a98-c379dcefb29f,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:03.178907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:03.245643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-223249ad-8177-4968-99bf-59bf14f974bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:03.247153 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-223249ad-8177-4968-99bf-59bf14f974bc service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2496572
Jun 02 16:46:03.377692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:03.542482 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-36903cab-8bda-4c82-bf4f-f512e8be20e1 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:03.543961 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-36903cab-8bda-4c82-bf4f-f512e8be20e1 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 815 time: 0.3283947
Jun 02 16:46:03.547766 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-64aea0a9-423e-422c-9887-38ed869388b3 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2902155
Jun 02 16:46:03.548429 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:03.627205 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c40b3e23-1a7a-40bc-bc1a-66139040d339 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/quotas/6dfc0270498549a6a449e9aa4beb945e HTTP/1.1" status: 200  len: 375 time: 0.0543413
Jun 02 16:46:03.761626 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:03.835768 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-05afc145-a3c3-4113-9215-5358ee2f6873 req-780582f5-1eed-4eb2-b809-2f980dd6cd31 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2619293
Jun 02 16:46:03.843595 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee6f203-4141-4ff1-b4f4-fe4701103c92 req-2952d7c7-0b8f-4bf2-9217-82090f8970a9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:03.843595 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3ee6f203-4141-4ff1-b4f4-fe4701103c92 req-2952d7c7-0b8f-4bf2-9217-82090f8970a9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.0843198
Jun 02 16:46:03.896274 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3ee6f203-4141-4ff1-b4f4-fe4701103c92 req-78bc023a-089b-46fa-8ed3-118557d70975 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430655
Jun 02 16:46:03.925868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device fb1aaf42-cb49-4b75-8a08-00c10908c38a details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:46:03.988818 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-0462da99-a910-4dab-9d75-aa0c50714c74 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&fields=id HTTP/1.1" status: 200  len: 302 time: 0.3468227
Jun 02 16:46:04.032522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-ddf995e0-158e-488e-8f07-c7c6c07f076f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:04.034109 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-ddf995e0-158e-488e-8f07-c7c6c07f076f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1098 time: 0.1488562
Jun 02 16:46:04.046176 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.070453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.087088 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:04.095105 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-644f5f79-d132-4673-815a-d39c0c453886 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:04.101731 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 688, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:46:04.170562 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.193114 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb1aaf42-cb49-4b75-8a08-00c10908c38a {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:04.214319 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:04.219334 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.222867 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:04.282958 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=a3702686-f2bf-414e-9a98-c379dcefb29f,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:04.293914 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3952873-88f4-438d-a0a2-4ba04f15a667 req-c687c640-24fa-4777-a063-705330dddd21 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:04.295546 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3952873-88f4-438d-a0a2-4ba04f15a667 req-c687c640-24fa-4777-a063-705330dddd21 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 945 time: 0.0889699
Jun 02 16:46:04.297870 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:04.301169 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:04.338971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:04.343135 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f3952873-88f4-438d-a0a2-4ba04f15a667 req-42449d2d-484b-49e4-9ba5-2ee7451f67fa tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408807
Jun 02 16:46:04.379268 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.428754 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-95710633-bdf8-4dd8-8af7-6e1c80770a0a service neutron] 10.222.0.25 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4257381
Jun 02 16:46:04.433385 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-a2c3b1aa-6175-44a8-b2c9-bf57f91e031e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:04.434823 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-a2c3b1aa-6175-44a8-b2c9-bf57f91e031e service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.3916812
Jun 02 16:46:04.460135 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['fb1aaf42-cb49-4b75-8a08-00c10908c38a'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:04.617086 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:04.621368 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.0591533
Jun 02 16:46:04.745699 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-a03a2b5f-d0a7-4e9a-bd27-6e62725fad97 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 1000 time: 0.2858911
Jun 02 16:46:04.823026 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-5fc11e2d-8be3-4164-9505-13c19ebf81fd service neutron] 10.222.0.25 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3865671
Jun 02 16:46:04.840005 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-0bd88dff-c9a7-4aa9-801f-3addaedab6c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:04.841488 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-0bd88dff-c9a7-4aa9-801f-3addaedab6c3 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0894480
Jun 02 16:46:04.915229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-4974fc28-5b50-44c2-8bd5-5352af914195 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:04.926374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-d6f0da15-9d56-441a-8c8e-935a313a477e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:04.927964 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-d6f0da15-9d56-441a-8c8e-935a313a477e service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0784736
Jun 02 16:46:04.939357 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-4974fc28-5b50-44c2-8bd5-5352af914195 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:04.940644 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-4974fc28-5b50-44c2-8bd5-5352af914195 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--305634712&fields=id&tenant_id=5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 267 time: 0.0757756
Jun 02 16:46:05.131823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-e3e6ffe7-4d15-4ee5-872f-d9e3664676b4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:05.132593 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-e3e6ffe7-4d15-4ee5-872f-d9e3664676b4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:network {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:05.153297 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-e3e6ffe7-4d15-4ee5-872f-d9e3664676b4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:network {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:05.155313 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-41c807b1-5eb7-4398-ada3-f635d9c47bc2 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2186463
Jun 02 16:46:05.157479 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-e3e6ffe7-4d15-4ee5-872f-d9e3664676b4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 811 time: 0.2066035
Jun 02 16:46:05.171594 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-94b685e1-0d1a-49c2-9feb-584626268f57 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/quotas/5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 375 time: 0.0099907
Jun 02 16:46:05.228671 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0330bd82-2e20-4638-8e5b-e70ddcadb224 req-3bc9f7e2-fecc-4f2b-bb7c-bfdb2ed01ab9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:05.230197 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0330bd82-2e20-4638-8e5b-e70ddcadb224 req-3bc9f7e2-fecc-4f2b-bb7c-bfdb2ed01ab9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 945 time: 0.1756840
Jun 02 16:46:05.265754 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-62b3f1b8-09ac-42cd-bd3c-7cd13b8d07e2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:05.285954 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-418b8809-1071-4758-9707-1038129b9996 req-62b3f1b8-09ac-42cd-bd3c-7cd13b8d07e2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:05.287957 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-62b3f1b8-09ac-42cd-bd3c-7cd13b8d07e2 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1099460
Jun 02 16:46:05.368832 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0330bd82-2e20-4638-8e5b-e70ddcadb224 req-dee80491-ee80-49f6-ba98-cd09bc52f15d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0878041
Jun 02 16:46:05.373198 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-33940981-d41d-43fd-8355-b8c3bc34a8a0 req-9c3d0356-d4d3-4666-b6be-b4b3d59790bb service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2100661
Jun 02 16:46:05.521279 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-464d8d1b-6a99-44d5-a731-eacc14957075 service neutron] 10.222.0.25 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2170672
Jun 02 16:46:05.567619 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4d6c2cf0-b451-4d75-a623-fae248bec8af req-aa1daafd-400c-43c0-a4e4-7211cd3320ce tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 210 time: 0.0612853
Jun 02 16:46:05.686546 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-2657964b-8e00-4fec-aee3-649662b131ef service neutron] 10.222.0.25 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1534419
Jun 02 16:46:05.775910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684aa04-23bf-445a-9aae-3a6303304db9 req-bb8263e4-672b-46ab-add7-5e47ad8bbc94 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:05.777275 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b684aa04-23bf-445a-9aae-3a6303304db9 req-bb8263e4-672b-46ab-add7-5e47ad8bbc94 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 945 time: 0.0984256
Jun 02 16:46:05.833942 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b684aa04-23bf-445a-9aae-3a6303304db9 req-60e60e33-cdba-47b5-8f62-9ff51467d7e3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0499320
Jun 02 16:46:05.887523 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-400bd94b-0b09-4688-ba75-b558c1769f64 req-d97c5262-0747-40d1-a1b2-4c8590218c34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0509574
Jun 02 16:46:05.951403 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device fb1aaf42-cb49-4b75-8a08-00c10908c38a up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:46:06.027443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port fb1aaf42-cb49-4b75-8a08-00c10908c38a completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:06.036990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port fb1aaf42-cb49-4b75-8a08-00c10908c38a triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:06.037473 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.185952 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.242691 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:06.245733 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08860793-daa8-4a9d-a18f-7ef81d733603" -d '{"events": [{"server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "name": "network-vif-plugged", "status": "completed", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:06.256143 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:06.263389 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.264513 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:46:06.281438 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-7e19bb77-5a7b-41c8-8ec2-d4aefa46dec3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:06.283561 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-7e19bb77-5a7b-41c8-8ec2-d4aefa46dec3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 815 time: 0.2002165
Jun 02 16:46:06.299907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'port': {'device_id': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'admin_state_up': True, 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:06.329871 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9492b0c8-bd25-41c8-9609-99ed599ea82e x-openstack-request-id: req-9492b0c8-bd25-41c8-9609-99ed599ea82e {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:06.330228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "name": "network-vif-plugged", "status": "completed", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:06.330412 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9492b0c8-bd25-41c8-9609-99ed599ea82e {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:06.330792 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'code': 200}
Jun 02 16:46:06.331441 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:06.470545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.481696 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:06.487214 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:06.522712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:06.526445 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:06.529298 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:port and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:06.537093 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.543998 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:06.544209 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:06.558070 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:06.579006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Made reservation on behalf of 6dfc0270498549a6a449e9aa4beb945e for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:46:06.591562 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:06.629856 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0bf9bb-3ee1-417b-990f-6d81e59ed9a4 req-f008889e-db4d-408a-9969-4799c942d98b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:06.631379 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c0bf9bb-3ee1-417b-990f-6d81e59ed9a4 req-f008889e-db4d-408a-9969-4799c942d98b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1204727
Jun 02 16:46:06.712759 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=8']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:06.721347 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c0bf9bb-3ee1-417b-990f-6d81e59ed9a4 req-175c28a9-4336-4faf-8d92-9a7ca2ab871a tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0799932
Jun 02 16:46:06.732959 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:06.848361 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e920c519-0340-4c09-adf0-f2863cb38f7c req-c200ecf5-e99f-454b-bdf0-46404c1eee98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:06.849989 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e920c519-0340-4c09-adf0-f2863cb38f7c req-c200ecf5-e99f-454b-bdf0-46404c1eee98 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1099 time: 0.1327512
Jun 02 16:46:06.855142 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e4f62c3c-b2cf-4acb-a7c5-8c10e18bfed0 req-933664ac-332a-48b7-8197-1ceba3a5c28f tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 210 time: 0.0637822
Jun 02 16:46:06.935562 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e920c519-0340-4c09-adf0-f2863cb38f7c req-369338c2-a004-4720-88c8-983175e0483c service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0651677
Jun 02 16:46:07.086011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Allocated IP 172.20.0.3 (51db2abb-3ad8-4a20-b616-e97be139cc03/49ee6390-6171-4f16-99cc-b1c7e54d783e/c9e943c6-ac63-43f5-8ebb-c758200b9c17) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:07.214892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba7d185-b148-4c7e-af07-02eaa05d7904 req-1f2b95ac-0d65-456e-938a-f9c7b564ce1a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:07.234073 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ba7d185-b148-4c7e-af07-02eaa05d7904 req-1f2b95ac-0d65-456e-938a-f9c7b564ce1a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1650932
Jun 02 16:46:07.270927 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a879daa5-6e4e-4b84-b2a4-09f747e1bb68 req-a7bcf60a-c7c2-4f30-a5e7-6acb2e38a82e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0982625
Jun 02 16:46:07.320427 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6ba7d185-b148-4c7e-af07-02eaa05d7904 req-5b430f7d-d11f-40e1-ba7e-ce516d0ee018 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0776176
Jun 02 16:46:07.568209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:07.593057 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Transition to ACTIVE for port object c9e943c6-ac63-43f5-8ebb-c758200b9c17 will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:07.622102 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:07.630394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:07.702824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:07.711604 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:07.717281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:07.782018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:07.795054 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:07.835584 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:07.836300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:07.868300 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-c8853955-fdc4-45f4-8d7e-dd4aa970e853 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5745394
Jun 02 16:46:08.094907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94af4aae-c739-47d2-979c-4c8976da8f50 req-488b5552-c6bf-4e6c-8755-7edd679a367c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:08.098999 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-94af4aae-c739-47d2-979c-4c8976da8f50 req-488b5552-c6bf-4e6c-8755-7edd679a367c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1727915
Jun 02 16:46:08.107963 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-f2516f2e-6cc1-42fe-8959-c136a862a81f None None] Provisioning for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:08.123048 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-f2516f2e-6cc1-42fe-8959-c136a862a81f None None] Provisioning complete for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:08.123422 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-f2516f2e-6cc1-42fe-8959-c136a862a81f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:08.150732 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-3e6cafec-8b59-406e-b2a2-eaaf755caccd tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:08.151427 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-3e6cafec-8b59-406e-b2a2-eaaf755caccd tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:08.205723 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-94af4aae-c739-47d2-979c-4c8976da8f50 req-f8d97181-9872-4314-b1a4-d198f6c9e2e6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0912566
Jun 02 16:46:08.212732 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-3e6cafec-8b59-406e-b2a2-eaaf755caccd tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:08.214068 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-3e6cafec-8b59-406e-b2a2-eaaf755caccd tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1658962
Jun 02 16:46:08.232605 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-f2516f2e-6cc1-42fe-8959-c136a862a81f None None] Port c9e943c6-ac63-43f5-8ebb-c758200b9c17 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:46:08.279871 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-7ebab59a-5fb0-47fb-9a2d-69819a3c9764 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:08.316382 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-7ebab59a-5fb0-47fb-9a2d-69819a3c9764 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:08.317674 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-711e8a98-8bb8-45f8-8f96-3d110c32277d req-7ebab59a-5fb0-47fb-9a2d-69819a3c9764 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0965106
Jun 02 16:46:08.338579 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:08.344879 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b2255de-e92b-4937-ab67-0414d4de4e5f" -d '{"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-unplugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:08.459943 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5cc8bca8-adf7-4220-8686-7836274ce1ab req-0b9b25d8-2858-4b7a-a625-662593ed54a7 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0469604
Jun 02 16:46:08.519829 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4230f23e-7bdc-4462-927c-616ab15d2519 x-openstack-request-id: req-4230f23e-7bdc-4462-927c-616ab15d2519 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:08.520123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-unplugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:08.520384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-4230f23e-7bdc-4462-927c-616ab15d2519 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:08.520783 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'code': 200}
Jun 02 16:46:08.558798 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ff4b98-7e82-4b11-af37-bc1f220f92fa req-1106c73e-2989-44e7-9ca8-7a30c292e431 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:08.561048 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a0ff4b98-7e82-4b11-af37-bc1f220f92fa req-1106c73e-2989-44e7-9ca8-7a30c292e431 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1128352
Jun 02 16:46:08.645740 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a0ff4b98-7e82-4b11-af37-bc1f220f92fa req-dbdc608c-0e4c-481d-93bc-1f60ab3b4e64 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0781443
Jun 02 16:46:09.440115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7ee9f3-399b-43e0-aea2-62db76aa41a7 req-54e299d8-3202-47c8-a579-283ca1299b0b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:09.441584 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-df7ee9f3-399b-43e0-aea2-62db76aa41a7 req-54e299d8-3202-47c8-a579-283ca1299b0b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0982840
Jun 02 16:46:09.526284 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-df7ee9f3-399b-43e0-aea2-62db76aa41a7 req-6322430a-f432-41aa-abf3-de4b2a77a016 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0783257
Jun 02 16:46:09.550478 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2c065b-6405-4fe2-a243-d5ee71205cd2 req-6ee01a3e-7d5f-4417-ad66-afac6d59f028 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:09.552399 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ca2c065b-6405-4fe2-a243-d5ee71205cd2 req-6ee01a3e-7d5f-4417-ad66-afac6d59f028 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.0941069
Jun 02 16:46:09.606439 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ca2c065b-6405-4fe2-a243-d5ee71205cd2 req-53c9c909-ffce-4067-953e-1641d1e58528 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473728
Jun 02 16:46:09.694070 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41206a1f-8420-4a9f-b482-1091ce4f41d6 req-ec88b4fd-6c4a-401d-9dde-2a0255ff0030 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0456359
Jun 02 16:46:09.952013 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23fd3845-dbbd-4f78-a82a-9b1ca24f6316 req-9c6b4e1d-17e7-499e-b180-b1be788a8ea8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:09.953882 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23fd3845-dbbd-4f78-a82a-9b1ca24f6316 req-9c6b4e1d-17e7-499e-b180-b1be788a8ea8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1928687
Jun 02 16:46:10.006266 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23fd3845-dbbd-4f78-a82a-9b1ca24f6316 req-d9bd4d9e-58e5-4202-a0b3-a0a3976c74a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409660
Jun 02 16:46:10.775747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23478da5-d300-4803-a347-d9c8472d43fb req-bdb860f4-1604-44e2-925f-f6f29e53b0c7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:10.777283 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23478da5-d300-4803-a347-d9c8472d43fb req-bdb860f4-1604-44e2-925f-f6f29e53b0c7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1102719
Jun 02 16:46:10.835660 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23478da5-d300-4803-a347-d9c8472d43fb req-1c130d63-af6d-4a89-9541-0d612f7a7424 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0521078
Jun 02 16:46:10.855278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f410ca31-3b29-424c-bd00-8bc1147a6efe req-8ae3d36c-4a21-48e8-9453-7aeda9fa7f31 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:10.855278 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f410ca31-3b29-424c-bd00-8bc1147a6efe req-8ae3d36c-4a21-48e8-9453-7aeda9fa7f31 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1244533
Jun 02 16:46:10.914704 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-f410ca31-3b29-424c-bd00-8bc1147a6efe req-8efe8e9d-77f3-44e3-b327-6c749d28e7d7 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0593133
Jun 02 16:46:10.994898 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b5ea7350-cf6f-4ae4-b775-a43a439c9e1b req-ee12f3db-9b58-4905-b770-6a105631c3e4 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0485115
Jun 02 16:46:11.210179 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267d09d2-e82f-4702-8ec3-2de7aedd2019 req-3a5678aa-011b-4b30-8f7d-f4d1b49d1053 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:11.211643 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-267d09d2-e82f-4702-8ec3-2de7aedd2019 req-3a5678aa-011b-4b30-8f7d-f4d1b49d1053 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0871825
Jun 02 16:46:11.259354 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-267d09d2-e82f-4702-8ec3-2de7aedd2019 req-4bc36c25-5b31-4cd1-b589-a684faac8d35 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418494
Jun 02 16:46:12.050371 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743580fb-cced-4400-8f56-ad50b2d828b9 req-6bb0705b-3004-442f-8a3b-1b829de434e6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:12.051990 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-743580fb-cced-4400-8f56-ad50b2d828b9 req-6bb0705b-3004-442f-8a3b-1b829de434e6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1009581
Jun 02 16:46:12.103946 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-743580fb-cced-4400-8f56-ad50b2d828b9 req-6e3fcbdb-730d-4198-92a4-3281d5bea8bf tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456817
Jun 02 16:46:12.159822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c69a8a-2e68-4078-a4ae-82cf66f62b23 req-f303a363-e774-4c9d-84b0-22dee42e7409 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:12.161761 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-41c69a8a-2e68-4078-a4ae-82cf66f62b23 req-f303a363-e774-4c9d-84b0-22dee42e7409 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1055226
Jun 02 16:46:12.232394 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-41c69a8a-2e68-4078-a4ae-82cf66f62b23 req-b720f9e3-53a6-4191-b10f-ee1527be2409 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0626581
Jun 02 16:46:12.310567 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-19d8591d-323e-4f58-a2b1-c477d07aa642 req-708fca02-f48a-4be3-95e7-1a562a33d6ed tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0745039
Jun 02 16:46:12.474635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d423aad4-962c-499c-822b-3fe6b0066f3f req-c423f94d-6682-4f8d-900e-68fdedda28a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:12.479955 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d423aad4-962c-499c-822b-3fe6b0066f3f req-c423f94d-6682-4f8d-900e-68fdedda28a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0931900
Jun 02 16:46:12.524604 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d423aad4-962c-499c-822b-3fe6b0066f3f req-436bff6f-9a12-421a-b73d-c2f934ca2735 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436480
Jun 02 16:46:13.312795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f57a792-dab1-4faa-8197-be24063b5a31 req-9d51122a-0aa6-4072-8b87-a53192d5680c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:13.315810 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f57a792-dab1-4faa-8197-be24063b5a31 req-9d51122a-0aa6-4072-8b87-a53192d5680c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0928893
Jun 02 16:46:13.378521 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f57a792-dab1-4faa-8197-be24063b5a31 req-2937482e-e27b-4e57-a608-6d3986e2c84b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0607467
Jun 02 16:46:13.487633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ab4d6e-8006-4708-b99d-f484ce7c3d8d req-a8b31798-9d06-47ba-b6fc-19415a326837 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:13.489110 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d5ab4d6e-8006-4708-b99d-f484ce7c3d8d req-a8b31798-9d06-47ba-b6fc-19415a326837 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1230917
Jun 02 16:46:13.557333 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-d8d650f8-2471-46d2-8b9a-e09b96dfc86d req-041d5ff8-ab2d-4f66-bcaa-886847700ac1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0637057
Jun 02 16:46:13.577042 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d5ab4d6e-8006-4708-b99d-f484ce7c3d8d req-783f7278-1c8e-490b-a13b-4122d8350ce8 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0735779
Jun 02 16:46:13.760760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0e348f4-9fe2-4149-a00e-eaa46a920984 req-83cc3dc9-18b7-4402-b19f-f9271074938e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:13.762412 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e0e348f4-9fe2-4149-a00e-eaa46a920984 req-83cc3dc9-18b7-4402-b19f-f9271074938e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0892956
Jun 02 16:46:13.808268 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e0e348f4-9fe2-4149-a00e-eaa46a920984 req-e2020d29-e0dd-4e1f-bb9c-09d083c20dc0 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382669
Jun 02 16:46:14.578178 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f47448d-300d-462c-8d18-04dee1e3f74a req-f72102bf-fe1b-4fae-b768-34ab4fb750dd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:14.579682 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7f47448d-300d-462c-8d18-04dee1e3f74a req-f72102bf-fe1b-4fae-b768-34ab4fb750dd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0866365
Jun 02 16:46:14.643442 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7f47448d-300d-462c-8d18-04dee1e3f74a req-8b55a61f-a15a-4810-bae3-fc985df237a1 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0562603
Jun 02 16:46:14.736115 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2c7f57b6-7379-4ae0-9b24-331137cfee04 req-9c084860-ec03-4cd5-9693-e99f8704abe9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0619133
Jun 02 16:46:14.843469 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d86980f-259b-4c82-9b86-f62d8903b142 req-07ff8c72-1056-408c-9b93-c55b4c700d43 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:14.845068 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7d86980f-259b-4c82-9b86-f62d8903b142 req-07ff8c72-1056-408c-9b93-c55b4c700d43 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.0857940
Jun 02 16:46:14.907623 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7d86980f-259b-4c82-9b86-f62d8903b142 req-16621ba3-dadf-4d76-90fb-36fa32c3b6f5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524378
Jun 02 16:46:15.003092 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50da494f-f823-43ad-9c16-702720473f03 req-24d2aac6-4b96-4a69-953f-f86b7faef9ff tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:15.004635 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50da494f-f823-43ad-9c16-702720473f03 req-24d2aac6-4b96-4a69-953f-f86b7faef9ff tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0892677
Jun 02 16:46:15.051639 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50da494f-f823-43ad-9c16-702720473f03 req-eceb86db-10f7-435d-a402-f659490bc786 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411952
Jun 02 16:46:15.877190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1741dc71-1ca0-45ee-92e7-cf5c346debb2 req-4f6e4c49-2e44-4365-ae0a-14e21960eea5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:15.878866 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1741dc71-1ca0-45ee-92e7-cf5c346debb2 req-4f6e4c49-2e44-4365-ae0a-14e21960eea5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1038516
Jun 02 16:46:15.890863 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-93fe7880-15a0-4260-9c4e-9172ead209ee req-3553231e-0415-4cdf-98c9-c167cdc84965 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0457466
Jun 02 16:46:15.930152 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1741dc71-1ca0-45ee-92e7-cf5c346debb2 req-aeb4f1db-b444-4aa0-8448-06869ac27f31 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456266
Jun 02 16:46:16.118467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfd2a02-74a1-40a7-bc65-79ea4984a56a req-cf6b01de-f2f4-4c54-a9f2-42580416fd29 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:16.119835 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5bfd2a02-74a1-40a7-bc65-79ea4984a56a req-cf6b01de-f2f4-4c54-a9f2-42580416fd29 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:16.133802 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-5bfd2a02-74a1-40a7-bc65-79ea4984a56a req-cf6b01de-f2f4-4c54-a9f2-42580416fd29 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:16.135084 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5bfd2a02-74a1-40a7-bc65-79ea4984a56a req-cf6b01de-f2f4-4c54-a9f2-42580416fd29 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1159925
Jun 02 16:46:16.180898 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5bfd2a02-74a1-40a7-bc65-79ea4984a56a req-5a5ba55a-2408-4107-b008-9e172576e5b5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399034
Jun 02 16:46:16.274415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372f0d-e7c8-4fdc-846e-d214abf5504a req-375f0bdb-5f0e-4ee8-ace3-021c04f1db37 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:16.275851 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-83372f0d-e7c8-4fdc-846e-d214abf5504a req-375f0bdb-5f0e-4ee8-ace3-021c04f1db37 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0909126
Jun 02 16:46:16.330521 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-83372f0d-e7c8-4fdc-846e-d214abf5504a req-72fb7b41-550c-4926-806a-c7abee66a839 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0477784
Jun 02 16:46:17.055730 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-60461870-c9ef-476c-9777-73e46f6688f4 req-3098509f-9bc3-4dd7-a26c-476eb500e773 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0420384
Jun 02 16:46:17.143959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14580626-7d6c-493b-a47b-c134c5021faa req-bf559c04-dd7a-40fa-b8bc-412aa732de15 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:17.145450 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14580626-7d6c-493b-a47b-c134c5021faa req-bf559c04-dd7a-40fa-b8bc-412aa732de15 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0885503
Jun 02 16:46:17.192489 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14580626-7d6c-493b-a47b-c134c5021faa req-d62486f4-a8cd-41cd-902b-2084b40dc6e6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412700
Jun 02 16:46:17.388373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ac1bb5-fd44-48b5-b811-ba292909c72e req-f3855f3f-52d9-49ae-9ec9-68d1002b5c07 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:17.389866 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81ac1bb5-fd44-48b5-b811-ba292909c72e req-f3855f3f-52d9-49ae-9ec9-68d1002b5c07 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.0911973
Jun 02 16:46:17.436523 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-81ac1bb5-fd44-48b5-b811-ba292909c72e req-e9141426-21e5-46ee-8a2f-c76a1176e31d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406415
Jun 02 16:46:17.519829 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6267a93-418a-48b5-9ac8-935d34dc495f req-a1ddc0b9-4330-43c0-a87d-d52f9d75592c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:17.521277 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b6267a93-418a-48b5-9ac8-935d34dc495f req-a1ddc0b9-4330-43c0-a87d-d52f9d75592c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0800192
Jun 02 16:46:17.567521 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b6267a93-418a-48b5-9ac8-935d34dc495f req-252e237f-2db9-43a2-9b46-e1759b84a2b0 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377479
Jun 02 16:46:17.927116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Request body: {'port': {'device_id': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:18.042098 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:18.246924 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9c072eb5-638a-427d-97dd-58f65b4bcb11 req-d14b58fa-9a1f-4119-91c6-de6dcf66139a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0561421
Jun 02 16:46:18.483851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-a62bace6-3701-4c8a-aba1-36c48c75e287 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:18.486384 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-a62bace6-3701-4c8a-aba1-36c48c75e287 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 811 time: 0.2705092
Jun 02 16:46:18.509515 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92071774-af59-48f9-af90-669ca4b6d2ac req-4234e9d0-4d83-43ce-958d-8d61056bdca6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:18.510738 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-92071774-af59-48f9-af90-669ca4b6d2ac req-4234e9d0-4d83-43ce-958d-8d61056bdca6 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1918793
Jun 02 16:46:18.558667 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:46:18.606982 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-89fbb2e0-014f-4243-8024-57c28bd28c30 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5febf86d75284ccb9dac5e0dadffd715 HTTP/1.1" status: 200  len: 379 time: 0.0950816
Jun 02 16:46:18.626524 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'port': {'device_id': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'admin_state_up': True, 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'security_groups': ['dd9e62fc-8b34-4a3f-8e16-bffb722741af']}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:18.653146 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c9e943c6-ac63-43f5-8ebb-c758200b9c17 {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:18.662811 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:18.671729 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-92071774-af59-48f9-af90-669ca4b6d2ac req-625da5e9-d4d1-4f0f-aa31-c36cd105b4b9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1093967
Jun 02 16:46:18.700155 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Transition to ACTIVE for port object c9e943c6-ac63-43f5-8ebb-c758200b9c17 will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:18.710036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ca384d-f3bf-4d30-ad1a-6a307e745db0 req-3559922b-3da1-4539-a82c-eca48f34541e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:18.717401 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-54ca384d-f3bf-4d30-ad1a-6a307e745db0 req-3559922b-3da1-4539-a82c-eca48f34541e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 931 time: 0.1239331
Jun 02 16:46:18.736885 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:18.746023 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:18.777526 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:18.788828 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:18.840333 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Made reservation on behalf of 5febf86d75284ccb9dac5e0dadffd715 for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:46:18.843430 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:18.906567 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-54ca384d-f3bf-4d30-ad1a-6a307e745db0 req-a7148bb6-c186-43ee-9c1e-c7b198f66b98 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1884310
Jun 02 16:46:18.949989 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:19.001253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.001810 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.002131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.002488 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.002866 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.003199 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.003547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.003969 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.004326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.004844 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.005469 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.005469 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:19.009387 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:19.026597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2e5ec5-eaa2-4594-8db8-a4d7415f2051 req-e9b4c15a-32d8-4c26-8b6a-b84928e0731b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.028286 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6b2e5ec5-eaa2-4594-8db8-a4d7415f2051 req-e9b4c15a-32d8-4c26-8b6a-b84928e0731b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.2298748
Jun 02 16:46:19.055807 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Attempting to bind port c9e943c6-ac63-43f5-8ebb-c758200b9c17 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:46:19.056200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Attempting to bind port c9e943c6-ac63-43f5-8ebb-c758200b9c17 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:46:19.056527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Attempting to bind port c9e943c6-ac63-43f5-8ebb-c758200b9c17 on network 51db2abb-3ad8-4a20-b616-e97be139cc03 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:19.066694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Port c9e943c6-ac63-43f5-8ebb-c758200b9c17 on network 51db2abb-3ad8-4a20-b616-e97be139cc03 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:46:19.067479 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Attempting to bind port c9e943c6-ac63-43f5-8ebb-c758200b9c17 on network 51db2abb-3ad8-4a20-b616-e97be139cc03 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:19.077619 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:46:19.078145 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Checking segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:46:19.078686 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Bound using segment: {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:46:19.079195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Bound port: c9e943c6-ac63-43f5-8ebb-c758200b9c17, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6e3737ad-312d-4822-9043-cd5248d86a63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:46:19.079778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.184743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:46:19.190109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:46:19.195688 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.201711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1855af52-92a5-412d-853b-0625d85aab63 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:19.240532 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6b2e5ec5-eaa2-4594-8db8-a4d7415f2051 req-c9382780-a5b4-4859-8bc7-c3ffb200149b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2029874
Jun 02 16:46:19.251296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Allocated IP 172.20.0.5 (715517d1-0353-4b9d-972e-92eb6241fe32/200a3016-0d3b-4aef-b80d-de65cae94521/550dbe6a-0a01-4a0d-a4d1-1aefbed2652d) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:19.254989 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.256000 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.257764 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-46349662-6882-43cb-b7f1-d206210a215c service neutron] 10.222.0.20 "PUT /v2.0/ports/c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 1093 time: 1.3362279
Jun 02 16:46:19.267030 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:19.270185 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b518b38-0318-4208-bde2-50600ff37456" -d '{"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:19.358939 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36fa097b-e752-470b-8aef-d9d5805f29d4 x-openstack-request-id: req-36fa097b-e752-470b-8aef-d9d5805f29d4 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:19.359359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:19.359707 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-36fa097b-e752-470b-8aef-d9d5805f29d4 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:19.360186 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:46:19.385388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-87cb801c-637c-4293-8fbe-d811ca692ff4 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:19.391743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:19.395258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:19.422515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-87cb801c-637c-4293-8fbe-d811ca692ff4 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:19.423795 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-87cb801c-637c-4293-8fbe-d811ca692ff4 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-562010228&fields=id&tenant_id=b110174a94dd4df89cc6dc7b34bb7170 HTTP/1.1" status: 200  len: 267 time: 0.1423221
Jun 02 16:46:19.437544 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-fa5862c6-ec9e-4fcd-a137-878a678b6567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.439227 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-fa5862c6-ec9e-4fcd-a137-878a678b6567 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1096 time: 0.1144407
Jun 02 16:46:19.513914 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2de7289e-a355-494a-970f-8e737b4732a7 req-45ba8562-631e-458b-a96c-f0e71ec4ba3e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0708041
Jun 02 16:46:19.559852 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-5186e680-3eba-43e0-ae5f-79d37e0d94f9 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 217 time: 0.0996494
Jun 02 16:46:19.561842 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.578057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Transition to ACTIVE for port object 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:19.604305 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.610226 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:19.674481 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Network 715517d1-0353-4b9d-972e-92eb6241fe32 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:19.677645 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:19.681458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:19.702987 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-f68d5166-cffa-4115-b13f-b759ebf5752c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.704811 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-f68d5166-cffa-4115-b13f-b759ebf5752c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.1348794
Jun 02 16:46:19.715663 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event updated for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:19.722636 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:19.755906 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.756477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.789581 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1758308
Jun 02 16:46:19.793238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-1dbd6696-5afb-4149-9efc-095b5b08d7c8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.793719 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-1dbd6696-5afb-4149-9efc-095b5b08d7c8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:network {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:19.804893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Request body: {'port': {'device_id': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:19.824936 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-1dbd6696-5afb-4149-9efc-095b5b08d7c8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:network {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:19.831747 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-1dbd6696-5afb-4149-9efc-095b5b08d7c8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 809 time: 0.3913624
Jun 02 16:46:19.851270 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-cda42871-4d3a-49e1-8b9b-8058e6a0562f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/quotas/b110174a94dd4df89cc6dc7b34bb7170 HTTP/1.1" status: 200  len: 375 time: 0.0184150
Jun 02 16:46:19.904230 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82135daf-ace3-4035-9531-693687b8e2c4 req-4ed1a8b5-9340-4762-8aea-75be2c0eb9e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:19.905730 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-4ed1a8b5-9340-4762-8aea-75be2c0eb9e7 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1844954
Jun 02 16:46:19.917368 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e2176863-f7d8-4d60-876b-1f5b402834df None None] Provisioning for port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:19.926176 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-e2176863-f7d8-4d60-876b-1f5b402834df None None] Provisioning complete for port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:19.926876 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e2176863-f7d8-4d60-876b-1f5b402834df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.949693 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:19.988708 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-e2176863-f7d8-4d60-876b-1f5b402834df None None] Port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:46:20.047711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-707f5d45-e429-4bc5-b55e-ac06f1c2c4f0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:20.072924 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-ef46832b-f5a8-43ba-903e-efb057cb2e13 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1602359
Jun 02 16:46:20.112543 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-707f5d45-e429-4bc5-b55e-ac06f1c2c4f0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:20.114031 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-707f5d45-e429-4bc5-b55e-ac06f1c2c4f0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2619615
Jun 02 16:46:20.192823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fb92c2-3ded-4df5-a2a4-0ac5843142a8 req-7aa4c3c3-f58d-43d2-9f03-efa7a96bd697 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:20.194314 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b0fb92c2-3ded-4df5-a2a4-0ac5843142a8 req-7aa4c3c3-f58d-43d2-9f03-efa7a96bd697 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1916814
Jun 02 16:46:20.311158 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82135daf-ace3-4035-9531-693687b8e2c4 req-72947d5c-44e1-4eaa-a187-d44de4e0e1dd service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2314768
Jun 02 16:46:20.323573 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b0fb92c2-3ded-4df5-a2a4-0ac5843142a8 req-ed0d5918-aa79-4834-bffe-0b2f19ec0225 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1158605
Jun 02 16:46:20.340571 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-9a7ca16a-9015-4fbb-96d4-ae219d6d0f4e service neutron] 10.222.0.25 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2118466
Jun 02 16:46:20.440403 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:20.451173 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:20.511249 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Transition to ACTIVE for port object 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:20.518607 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:20.523452 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-fc88c508-471f-4dd7-8d93-74ce78059e99 tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:20.654202 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-99afc51c-bfce-4cb2-8371-b78774ac611c service neutron] 10.222.0.25 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3071220
Jun 02 16:46:20.663875 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b518b38-0318-4208-bde2-50600ff37456 req-47e0850a-4223-417e-a6be-8c49acd207be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:20.665539 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-47e0850a-4223-417e-a6be-8c49acd207be service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1096 time: 0.2677958
Jun 02 16:46:20.665752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Pushing event updated for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:20.670376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:20.748225 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bb1663d-4389-4c0b-a571-570879dcab98 req-f27bf0ba-5458-4b61-afe7-17ba05017623 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:20.749777 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2bb1663d-4389-4c0b-a571-570879dcab98 req-f27bf0ba-5458-4b61-afe7-17ba05017623 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 943 time: 0.2950244
Jun 02 16:46:20.817027 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2bb1663d-4389-4c0b-a571-570879dcab98 req-3d2929b0-2109-444d-abb5-a89a65a982c2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599992
Jun 02 16:46:20.823864 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Attempting to bind port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:46:20.824378 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Attempting to bind port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:46:20.824886 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Attempting to bind port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:20.827611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b518b38-0318-4208-bde2-50600ff37456 req-de48071c-3655-4c92-8644-6ca909097d78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:20.829085 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-de48071c-3655-4c92-8644-6ca909097d78 service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.1538918
Jun 02 16:46:20.830132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d on network 715517d1-0353-4b9d-972e-92eb6241fe32 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:46:20.830445 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Attempting to bind port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d on network 715517d1-0353-4b9d-972e-92eb6241fe32 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:20.836692 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:46:20.837107 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Checking segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:46:20.837544 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Bound using segment: {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:46:20.838069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Bound port: 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a4855202-de9c-405c-afa8-a9d92ac32eb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:46:20.838487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:20.913204 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-dfd76a8e-ba40-4b43-b3d2-3224c3fed42f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 217 time: 0.0753109
Jun 02 16:46:20.980447 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b518b38-0318-4208-bde2-50600ff37456 req-c299f466-613d-4527-b4a1-c179f9dcc2e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:20.982191 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:46:20.986930 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-c299f466-613d-4527-b4a1-c179f9dcc2e8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.0667629
Jun 02 16:46:20.992000 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:46:21.000853 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:21.006869 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:21.074864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b518b38-0318-4208-bde2-50600ff37456 req-5ae8ed26-027d-447f-a8c1-9f53c4131ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.076503 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-5ae8ed26-027d-447f-a8c1-9f53c4131ec1 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0814848
Jun 02 16:46:21.216618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.217300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:21.218945 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] 10.222.0.20 "PUT /v2.0/ports/550dbe6a-0a01-4a0d-a4d1-1aefbed2652d HTTP/1.1" status: 200  len: 1093 time: 1.4193885
Jun 02 16:46:21.219702 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:21.222309 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3" -d '{"events": [{"name": "network-changed", "server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:21.250769 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291fd15b-ab3e-47c0-b132-ae1d556bd24d req-a82ce348-e9d8-4554-981c-9e51081f8c07 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.252395 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-291fd15b-ab3e-47c0-b132-ae1d556bd24d req-a82ce348-e9d8-4554-981c-9e51081f8c07 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.3197320
Jun 02 16:46:21.270635 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-d1431f25-c815-4547-9b70-bcabe5a2d8b0 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1864295
Jun 02 16:46:21.289170 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Pushing event updated for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:21.352891 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:21.406678 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-291fd15b-ab3e-47c0-b132-ae1d556bd24d req-3046db38-3770-4660-8494-abcfb36e2b93 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1432302
Jun 02 16:46:21.456781 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-182e2a82-6c3d-4968-9801-26b7b554cee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.458641 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-182e2a82-6c3d-4968-9801-26b7b554cee1 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 1096 time: 0.1943088
Jun 02 16:46:21.477537 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6b518b38-0318-4208-bde2-50600ff37456 req-aab16d37-49a9-4c46-b4b9-5fec445c25ff service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1945593
Jun 02 16:46:21.591781 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-9e1f8a9f-7cf3-4e9c-a704-041fe8bda646 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d HTTP/1.1" status: 200  len: 217 time: 0.1225591
Jun 02 16:46:21.712967 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-61a15f9b-c269-4053-8bb9-ab86a833050c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.714440 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-61a15f9b-c269-4053-8bb9-ab86a833050c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.1160283
Jun 02 16:46:21.819959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8829f2d5-4c5a-491d-9849-9156e0984299 req-23f51887-0571-4dbe-b555-6e62fc6c90cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.821013 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-8829f2d5-4c5a-491d-9849-9156e0984299 req-23f51887-0571-4dbe-b555-6e62fc6c90cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:21.846102 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-8829f2d5-4c5a-491d-9849-9156e0984299 req-23f51887-0571-4dbe-b555-6e62fc6c90cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:21.847517 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8829f2d5-4c5a-491d-9849-9156e0984299 req-23f51887-0571-4dbe-b555-6e62fc6c90cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 943 time: 0.2157950
Jun 02 16:46:21.850423 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418b8809-1071-4758-9707-1038129b9996 req-fcf52382-381e-4feb-8c7a-aaca1e4091db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:21.851812 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-fcf52382-381e-4feb-8c7a-aaca1e4091db service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1247125
Jun 02 16:46:21.997750 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2d1fde26-b726-4a1e-8cc2-1da0fef56f46 req-211c167c-96e4-435a-81af-061dbef4dde1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 210 time: 0.0474927
Jun 02 16:46:22.005057 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8829f2d5-4c5a-491d-9849-9156e0984299 req-e384e365-acc2-427c-99dc-c5346fed04a9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1510470
Jun 02 16:46:22.039209 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:46:22.048308 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-ca544829-aa18-4fa1-beb3-e8b3523fff94 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1791546
Jun 02 16:46:22.054422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b80161b5-461e-4ce7-963d-ae3bb81f0929 x-openstack-request-id: req-b80161b5-461e-4ce7-963d-ae3bb81f0929 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:22.055161 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:22.055907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b80161b5-461e-4ce7-963d-ae3bb81f0929 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:22.056592 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'status': 'completed', 'code': 200}
Jun 02 16:46:22.241966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91adae6-bbf3-4726-9698-8be62d76dcdc req-0f46eabe-95cc-4245-b76e-9761bef3077e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.243387 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c91adae6-bbf3-4726-9698-8be62d76dcdc req-0f46eabe-95cc-4245-b76e-9761bef3077e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 943 time: 0.0910380
Jun 02 16:46:22.274495 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-418b8809-1071-4758-9707-1038129b9996 req-a4d1bb98-b17e-4999-bf08-312302699c24 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2144129
Jun 02 16:46:22.292276 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-c91adae6-bbf3-4726-9698-8be62d76dcdc req-4cf818d9-d06e-40da-b95c-6f2b2c044e0c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431812
Jun 02 16:46:22.292852 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58d741d-6f13-4132-8c5e-3409bc518855 req-81bb3478-1e31-4a49-8df0-0b1bec3e659e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.294438 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b58d741d-6f13-4132-8c5e-3409bc518855 req-81bb3478-1e31-4a49-8df0-0b1bec3e659e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1788073
Jun 02 16:46:22.425433 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-6069ecdb-d33b-4d81-b626-79567d45d074 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.427340 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-6069ecdb-d33b-4d81-b626-79567d45d074 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 1096 time: 0.0894370
Jun 02 16:46:22.448777 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b58d741d-6f13-4132-8c5e-3409bc518855 req-26e553c4-696d-45f7-91a1-8e71b7026821 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1481738
Jun 02 16:46:22.475504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56342) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:22.523012 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-3744e234-e4c2-4d61-ae85-f2edb34a05a0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.525695 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-3744e234-e4c2-4d61-ae85-f2edb34a05a0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 809 time: 0.2003155
Jun 02 16:46:22.583394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-dfb75949-c129-4518-ad90-624f6f188a4c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:22.596480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-dfb75949-c129-4518-ad90-624f6f188a4c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:22.597779 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-dfb75949-c129-4518-ad90-624f6f188a4c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b110174a94dd4df89cc6dc7b34bb7170 HTTP/1.1" status: 200  len: 379 time: 0.0634339
Jun 02 16:46:22.608086 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'port': {'device_id': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'admin_state_up': True, 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'security_groups': ['15573404-5194-40a3-a9d2-cd9bc27c9c66']}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:22.635624 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-726fdbab-7bff-4179-81d8-f8e8a337afd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.637093 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-726fdbab-7bff-4179-81d8-f8e8a337afd9 service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1942408
Jun 02 16:46:22.643212 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49023ebd-664c-4dd4-91fb-281467f79014 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.647292 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-49023ebd-664c-4dd4-91fb-281467f79014 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1094 time: 0.1680777
Jun 02 16:46:22.647621 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56346) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:22.659513 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address': '172.20.0.11'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:22.710605 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:22.711884 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-47a079a8-71e8-43e3-b68d-cfab1e9d3f48 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d HTTP/1.1" status: 200  len: 217 time: 0.0661159
Jun 02 16:46:22.721415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:floatingip and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:22.726745 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:22.746177 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:22.781771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:22.782766 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-14c24b00-c69f-4ef6-b401-77f5461ed0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.784169 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-14c24b00-c69f-4ef6-b401-77f5461ed0a4 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.0650859
Jun 02 16:46:22.795960 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:22.813638 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:22.841363 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Made reservation on behalf of b110174a94dd4df89cc6dc7b34bb7170 for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:46:22.844908 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:22.876474 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-80a40ead-74d3-4db3-ae0e-f2e617c7e0ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:22.878024 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-80a40ead-74d3-4db3-ae0e-f2e617c7e0ab service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0873425
Jun 02 16:46:23.117352 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:23.157135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Allocated IP 172.20.0.3 (424e3c29-adf6-44ca-a36f-5399047a7f0c/0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9/4a1c5267-6d2d-4f20-832f-b6d07dd9c926) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:23.166837 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-8ed3746b-8cbd-406c-9a52-530882e4f9c8 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2737315
Jun 02 16:46:23.347254 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bccf587-daa9-420d-b686-c70ca9647721 req-41ff2dda-d749-4abb-93b5-a5bb51b8217d tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 210 time: 0.0972097
Jun 02 16:46:23.400942 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9ef26db5-a0eb-49d7-a812-f0c84333d2b3 req-9dc2fadd-6cd8-414f-bd4c-926925dee899 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2271373
Jun 02 16:46:23.559032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239b4eba-1974-4ab5-a192-3d7b13fa35d2 req-dce84860-ecfa-44cc-af1a-a0c418926c89 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:23.560555 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-239b4eba-1974-4ab5-a192-3d7b13fa35d2 req-dce84860-ecfa-44cc-af1a-a0c418926c89 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0894766
Jun 02 16:46:23.606703 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-239b4eba-1974-4ab5-a192-3d7b13fa35d2 req-80ed4794-7f2b-46e1-8da9-3f99321845fe tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398798
Jun 02 16:46:23.653288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.27.0.73 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/cfb0ca33-bcad-4e73-86d7-22f1e763ed2f) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:23.692560 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-6584b50a-6d71-431a-b29c-26c9cc37cb4c service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.4702966
Jun 02 16:46:23.705878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688bdf80-a0ca-4e08-a8bb-5d5db107cfb7 req-42fbc3c3-33ad-4707-909d-e7e779842a66 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:23.707507 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-688bdf80-a0ca-4e08-a8bb-5d5db107cfb7 req-42fbc3c3-33ad-4707-909d-e7e779842a66 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 943 time: 0.4519529
Jun 02 16:46:23.752531 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:23.797308 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5574ccaf-afa3-4fbe-80e5-6235f194fda2 req-62fead4d-521b-4673-8a5f-9a0fe289ed8b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:23.798891 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5574ccaf-afa3-4fbe-80e5-6235f194fda2 req-62fead4d-521b-4673-8a5f-9a0fe289ed8b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 943 time: 0.0947111
Jun 02 16:46:23.811943 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Transition to ACTIVE for port object 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:23.847344 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5574ccaf-afa3-4fbe-80e5-6235f194fda2 req-c4bf7f43-e37f-4b1a-9369-e8d9777ac4a1 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421801
Jun 02 16:46:23.884504 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-688bdf80-a0ca-4e08-a8bb-5d5db107cfb7 req-b8dac4a6-7a63-401b-b41f-3656669e268a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1626256
Jun 02 16:46:23.935582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:23.948087 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:23.953880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:24.027161 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:24.031309 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:24.038764 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:24.049485 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device c9e943c6-ac63-43f5-8ebb-c758200b9c17 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:46:24.071844 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:24.088214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:24.112390 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.119448 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-575d94fe-0270-4d98-9d52-563c1fb5c275 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:24.186300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:24.186919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.205892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:24.216709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:24.222944 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:24.223653 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:24.245492 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'port_id': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'mac_address': 'fa:16:3e:e4:a1:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 682, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:46:24.264286 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=cfb0ca33-bcad-4e73-86d7-22f1e763ed2f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:24.276951 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:24.293418 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5edf103b-0822-498f-9074-de0deae28472 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6898146
Jun 02 16:46:24.311929 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.330346 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c9e943c6-ac63-43f5-8ebb-c758200b9c17 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:24.339653 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Request body: {'port': {'device_id': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:24.349306 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:24.353789 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.356272 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-1992b920-ca18-49f0-b248-f41150a59720 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:24.429118 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-49b59ebe-a599-4bd0-ac82-f900d6b7dabb None None] Provisioning for port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:24.436037 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-49b59ebe-a599-4bd0-ac82-f900d6b7dabb None None] Provisioning complete for port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:24.436408 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-49b59ebe-a599-4bd0-ac82-f900d6b7dabb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.463276 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:24.486709 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.488111 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.488439 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.488750 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.489075 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.489394 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.489726 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.490219 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.490681 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.491143 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.491624 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.491945 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:46:24.495874 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:24.511034 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-49b59ebe-a599-4bd0-ac82-f900d6b7dabb None None] Port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:46:24.574646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:24.584298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:24.617867 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b51897-75b1-496a-89eb-44322e1b9b2a req-e4885f26-6e34-4152-b008-af4ded5e6b0e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:24.619346 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f0b51897-75b1-496a-89eb-44322e1b9b2a req-e4885f26-6e34-4152-b008-af4ded5e6b0e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 931 time: 0.1392324
Jun 02 16:46:24.686528 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f0b51897-75b1-496a-89eb-44322e1b9b2a req-e4fe25ef-d927-4a9c-af9e-2ae7cace101f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0565598
Jun 02 16:46:24.703710 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-647d568a-afff-4cad-9a15-aa5ed5fd8bff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:24.705539 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-647d568a-afff-4cad-9a15-aa5ed5fd8bff service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962&tenant_id=545e33df5ea046a0bb2be1fb482f75fb HTTP/1.1" status: 200  len: 1096 time: 0.1422713
Jun 02 16:46:24.811046 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-ff495ece-9795-4783-a0f2-ca1113ffa5f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:24.812516 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-ff495ece-9795-4783-a0f2-ca1113ffa5f6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1096 time: 0.0758233
Jun 02 16:46:24.955512 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-4940867b-e769-4008-96f7-95ad25eafc51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:24.956944 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-4940867b-e769-4008-96f7-95ad25eafc51 service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.1357088
Jun 02 16:46:25.035116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8b9ab0-ff46-41af-a2a8-a11c845c6b84 req-e77685fe-3030-4426-8edb-5d53076d6981 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.036619 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e8b9ab0-ff46-41af-a2a8-a11c845c6b84 req-e77685fe-3030-4426-8edb-5d53076d6981 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.3066890
Jun 02 16:46:25.104304 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-c056e6c6-12e2-470a-878a-89e197e2c71c service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 998 time: 0.1158502
Jun 02 16:46:25.129819 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3e8b9ab0-ff46-41af-a2a8-a11c845c6b84 req-d0e5508e-9a6b-43eb-a7c5-469113fc12bd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0853131
Jun 02 16:46:25.164824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3a15b6-b825-493e-9d8f-cd78a7674d06 req-8846b37f-3277-4a2e-be73-645ae871110b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.170324 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5b3a15b6-b825-493e-9d8f-cd78a7674d06 req-8846b37f-3277-4a2e-be73-645ae871110b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 944 time: 0.2123744
Jun 02 16:46:25.212439 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-b0824dd1-4989-42c4-95d5-e0e99632becc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.214067 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-b0824dd1-4989-42c4-95d5-e0e99632becc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.1026001
Jun 02 16:46:25.258616 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.273133 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5b3a15b6-b825-493e-9d8f-cd78a7674d06 req-676d9b87-538a-4cb5-b2e8-c59274f54bcf tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0993419
Jun 02 16:46:25.306783 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-c2b9ed43-cc2e-4457-8b56-e36d8f542475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.308260 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-c2b9ed43-cc2e-4457-8b56-e36d8f542475 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0843685
Jun 02 16:46:25.365718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:25.374533 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.402734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Transition to ACTIVE for port object 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:46:25.435374 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.445401 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5e0b6e6d-c773-402e-919f-bcea1003c19b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:25.449553 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-c9c5b325-c1d5-4ca6-86c8-4d228571b8a1 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1338131
Jun 02 16:46:25.591432 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3a7345d3-8143-4148-84cd-b4f068fcbf5b req-137ca24e-2619-4097-b532-83623242f548 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1339252
Jun 02 16:46:25.603158 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.629924 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:25.666404 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:25.680828 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1776598d-23f9-4b8b-8f12-d110c27e98b3 req-40518bdf-7348-45bc-8c73-eae26d119a7b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.682335 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1776598d-23f9-4b8b-8f12-d110c27e98b3 req-40518bdf-7348-45bc-8c73-eae26d119a7b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 943 time: 0.4274333
Jun 02 16:46:25.800905 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-84c46e9b-f832-4ddd-8537-482b2f97bcfd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.832062 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1776598d-23f9-4b8b-8f12-d110c27e98b3 req-9087006e-ee3f-4071-883d-df61baa2ebb0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1425190
Jun 02 16:46:25.851046 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Attempting to bind port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:46:25.851378 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Attempting to bind port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:46:25.851706 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Attempting to bind port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 on network 424e3c29-adf6-44ca-a36f-5399047a7f0c {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:25.910052 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 on network 424e3c29-adf6-44ca-a36f-5399047a7f0c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:46:25.910385 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Attempting to bind port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 on network 424e3c29-adf6-44ca-a36f-5399047a7f0c {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:46:25.926030 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:46:25.926373 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Checking segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:46:25.926751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Bound using segment: {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:46:25.927189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Bound port: 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '179e8978-8edc-4f99-a70d-1f4e8d45205a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 665, 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:46:25.927542 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:25.927738 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fc0faf-5a55-4155-afb1-a999120e5ad2 req-89812f0e-25be-449a-b878-c38ec7d8b70f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:25.929401 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-68fc0faf-5a55-4155-afb1-a999120e5ad2 req-89812f0e-25be-449a-b878-c38ec7d8b70f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0996947
Jun 02 16:46:25.979954 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-68fc0faf-5a55-4155-afb1-a999120e5ad2 req-19adcabf-7d2b-43dc-bf78-7fd796897b5d tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433419
Jun 02 16:46:26.068992 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:46:26.070655 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:46:26.072367 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.073688 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device c9e943c6-ac63-43f5-8ebb-c758200b9c17 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:46:26.081331 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.104641 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:46:26.105741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-90a1b6da-68ac-4e58-a926-13436d33897d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:26.239825 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=cfb0ca33-bcad-4e73-86d7-22f1e763ed2f,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:26.239825 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.241560 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:26.289095 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.299206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:26.299724 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:26.359871 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:26.360489 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.361931 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] 10.222.0.20 "PUT /v2.0/ports/4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 1093 time: 2.0327811
Jun 02 16:46:26.362486 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:26.364860 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b3ced71-4fad-4651-bbf1-17bb051b8263" -d '{"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:26.389278 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:26.389892 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.595973 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:26.632134 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.653164 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:26.662112 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'port_id': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'mac_address': 'fa:16:3e:90:2a:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:46:26.690078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:26.701493 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1817468-7032-4a95-aed2-47aecb93f2ca req-b764779a-b9c7-4ded-bebd-3655d37f9022 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:26.709294 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c1817468-7032-4a95-aed2-47aecb93f2ca req-b764779a-b9c7-4ded-bebd-3655d37f9022 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.3210137
Jun 02 16:46:26.763852 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-c1817468-7032-4a95-aed2-47aecb93f2ca req-a53afbb8-4e11-4ba5-bc83-8bd22e360601 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0540624
Jun 02 16:46:26.764293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:26.773903 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:26.786665 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP 1fdb1653-c232-484c-ba7e-bc157fc316bb associated. External IP: 172.27.0.73, port: fb1aaf42-cb49-4b75-8a08-00c10908c38a.
Jun 02 16:46:26.789248 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c5c216e-6ee0-4df8-a593-18732af82a91" -d '{"events": [{"server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "name": "network-vif-plugged", "status": "completed", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:26.798441 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.798636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963b1dfd-1dee-4f80-b933-46f9c1c2706b req-a8b38dd5-2c86-4f9b-ae3b-a50366efadd3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:26.804781 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-963b1dfd-1dee-4f80-b933-46f9c1c2706b req-a8b38dd5-2c86-4f9b-ae3b-a50366efadd3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 944 time: 0.2673357
Jun 02 16:46:26.812209 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:26.918899 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-963b1dfd-1dee-4f80-b933-46f9c1c2706b req-615dd73b-5682-4c49-8610-d09afd7a6d21 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1078408
Jun 02 16:46:26.922578 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:26.954854 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:26.978655 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6155769-7d78-4198-9058-345d7912c971 x-openstack-request-id: req-c6155769-7d78-4198-9058-345d7912c971 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:26.979005 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "name": "network-vif-plugged", "status": "completed", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:26.979252 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c6155769-7d78-4198-9058-345d7912c971 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:26.979843 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'code': 200}
Jun 02 16:46:27.031266 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af4e9794-6fd1-415d-a89b-7a76d1d276c9 x-openstack-request-id: req-af4e9794-6fd1-415d-a89b-7a76d1d276c9 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:27.031687 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:27.031940 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-af4e9794-6fd1-415d-a89b-7a76d1d276c9 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:27.032415 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'status': 'completed', 'code': 200}
Jun 02 16:46:27.058976 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:27.074179 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:27.088046 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:27.096509 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:27.096973 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.020s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:27.263926 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:27.284377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:27.388546 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:27.490783 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-27878791-3f37-4ced-8ae8-521c0c6ca121 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:27.493310 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-27878791-3f37-4ced-8ae8-521c0c6ca121 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1096 time: 0.5796447
Jun 02 16:46:27.508519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c56c9-f75c-403a-ba70-734c57bc30a4 req-b1d811b8-5c66-4f61-bbf7-b37be4dcc645 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:27.511616 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1d2c56c9-f75c-403a-ba70-734c57bc30a4 req-b1d811b8-5c66-4f61-bbf7-b37be4dcc645 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 944 time: 0.3189600
Jun 02 16:46:27.602547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1d2c56c9-f75c-403a-ba70-734c57bc30a4 req-9783da7e-f5d7-413a-bac6-8b068518abb7 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Synchronizing usage tracker for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:27.621504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1d2c56c9-f75c-403a-ba70-734c57bc30a4 req-9783da7e-f5d7-413a-bac6-8b068518abb7 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Unset dirty status for tenant:5febf86d75284ccb9dac5e0dadffd715 on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:27.622976 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1d2c56c9-f75c-403a-ba70-734c57bc30a4 req-9783da7e-f5d7-413a-bac6-8b068518abb7 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1054568
Jun 02 16:46:27.665068 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb81587-83db-4b44-bc07-087ec8fd2c7e req-014d4651-ad6e-495f-b1d3-e52bf5d61c32 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:27.665851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-0fb81587-83db-4b44-bc07-087ec8fd2c7e req-014d4651-ad6e-495f-b1d3-e52bf5d61c32 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:46:27.782539 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-0fb81587-83db-4b44-bc07-087ec8fd2c7e req-014d4651-ad6e-495f-b1d3-e52bf5d61c32 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:46:27.784094 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0fb81587-83db-4b44-bc07-087ec8fd2c7e req-014d4651-ad6e-495f-b1d3-e52bf5d61c32 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.3617394
Jun 02 16:46:27.844541 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:46:27.860072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-0fb81587-83db-4b44-bc07-087ec8fd2c7e req-cc5a0202-bc8a-4eb0-9bfb-cc05a77f4ddf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0658360
Jun 02 16:46:28.004456 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05d2870-65e7-4f6c-93ea-5d9bda69e774 req-3934ca0d-c260-4396-87b2-d6009eaf4b6b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:28.015738 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b05d2870-65e7-4f6c-93ea-5d9bda69e774 req-3934ca0d-c260-4396-87b2-d6009eaf4b6b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1332321
Jun 02 16:46:28.061510 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b05d2870-65e7-4f6c-93ea-5d9bda69e774 req-f8c00db6-fb74-402b-b77b-f52d23c9747d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446768
Jun 02 16:46:28.151462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:46:28.167734 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:46:28.179391 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:28.184965 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c168460>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:45:59Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:28.190826 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:28.248251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14409919-8e8c-4bd8-8311-b262b38326e7 req-b3e0cbd3-c7ac-4b44-9a56-b365f13d4c00 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:28.250976 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14409919-8e8c-4bd8-8311-b262b38326e7 req-b3e0cbd3-c7ac-4b44-9a56-b365f13d4c00 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1859705
Jun 02 16:46:28.285348 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8d182ef0-7562-4cbd-b1cd-dffac095b1a6 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 5.6366563
Jun 02 16:46:28.322159 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-14409919-8e8c-4bd8-8311-b262b38326e7 req-7ba30760-5f24-4365-a0d2-38e2513e96e7 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0659964
Jun 02 16:46:28.413977 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:28.524997 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a9414a70-6039-4ce6-9346-725e64b582e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:28.771447 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:28.837505 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0b03a4-3306-4edc-80aa-319e5ed50074 req-f631b4fd-c359-4378-9eaa-cd16c299f74d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:28.839064 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6f0b03a4-3306-4edc-80aa-319e5ed50074 req-f631b4fd-c359-4378-9eaa-cd16c299f74d tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 944 time: 0.0919385
Jun 02 16:46:28.845053 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c168460>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:24Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:28.850104 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:46:28.858858 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:28.859467 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c168460>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:28.886601 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6f0b03a4-3306-4edc-80aa-319e5ed50074 req-c53e042c-77a2-405c-9307-6a0936c4f289 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417228
Jun 02 16:46:29.034633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:29.037969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe4c3218-b65c-43da-a468-d0d5a0ed7856" -d '{"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:29.052863 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:29.104314 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b094f0f-6dfe-4ae4-ac01-9a710429b138 x-openstack-request-id: req-1b094f0f-6dfe-4ae4-ac01-9a710429b138 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:29.105049 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:29.105374 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1b094f0f-6dfe-4ae4-ac01-9a710429b138 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:29.105848 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'status': 'completed', 'code': 200}
Jun 02 16:46:29.133059 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91335fba-6312-4f0d-bf9c-d8d95e15f246 req-a430ef45-007c-48d1-a1be-946039785570 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:29.140568 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-91335fba-6312-4f0d-bf9c-d8d95e15f246 req-a430ef45-007c-48d1-a1be-946039785570 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.1483443
Jun 02 16:46:29.218585 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-91335fba-6312-4f0d-bf9c-d8d95e15f246 req-3852fec1-a9d7-475a-b105-db5fd5554153 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0769937
Jun 02 16:46:29.387533 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762021ee-4cdb-42f5-a982-06fbaf50ee64 req-26d5d860-825e-4cb4-8e40-9596776a9785 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:29.389480 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-762021ee-4cdb-42f5-a982-06fbaf50ee64 req-26d5d860-825e-4cb4-8e40-9596776a9785 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1173105
Jun 02 16:46:29.451129 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-762021ee-4cdb-42f5-a982-06fbaf50ee64 req-d5ebe2a9-d510-4b21-8dd1-1d6dee6a7226 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0524833
Jun 02 16:46:29.548296 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c168460>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:24Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:29.552658 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a538bb-849d-43cf-9687-c6a90f06784d None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:24Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:46:29.566521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c18a7e-a178-4cc0-9f1d-7ae507b165b9 req-738b315f-4933-4617-9941-cf2a52176939 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:29.569042 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a3c18a7e-a178-4cc0-9f1d-7ae507b165b9 req-738b315f-4933-4617-9941-cf2a52176939 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0888069
Jun 02 16:46:29.630692 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a3c18a7e-a178-4cc0-9f1d-7ae507b165b9 req-377884b6-98a3-4cdd-ada0-f7de8a902f7b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0544472
Jun 02 16:46:29.763943 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-146cc5c8-87c7-408a-a07d-93f8c1c9730b None None] New status for floating IP 1fdb1653-c232-484c-ba7e-bc157fc316bb: ACTIVE {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:46:30.074383 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:46:30.112685 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc4d058-3eef-409b-b00a-5af8068dc6d7 req-3e3493dd-5879-468d-a8b7-a5c5f8bc677e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:30.114267 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-efc4d058-3eef-409b-b00a-5af8068dc6d7 req-3e3493dd-5879-468d-a8b7-a5c5f8bc677e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 944 time: 0.0945489
Jun 02 16:46:30.159664 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:30.163627 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-efc4d058-3eef-409b-b00a-5af8068dc6d7 req-37c692b7-5d79-4341-b204-9fb7f90af382 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423293
Jun 02 16:46:30.167876 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:30.168282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:30.237594 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:30.306644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:30.336064 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:30.338815 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a11e1b9-ecce-4c24-b4d5-ed5d9bd13e9e" -d '{"events": [{"server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "name": "network-vif-plugged", "status": "completed", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:30.347978 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:30.354160 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:30.358568 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:30.415092 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c04c5635-8aa3-4b4d-9639-349099c88f3b x-openstack-request-id: req-c04c5635-8aa3-4b4d-9639-349099c88f3b {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:30.415650 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "name": "network-vif-plugged", "status": "completed", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:30.416063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c04c5635-8aa3-4b4d-9639-349099c88f3b {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:30.416620 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'code': 200}
Jun 02 16:46:30.449242 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:30.449890 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8211d7b3-883b-424b-a15b-c40fe1f9aca1 req-b822bbc9-e1cc-4514-b378-732b5e9bf27e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:30.452438 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8211d7b3-883b-424b-a15b-c40fe1f9aca1 req-b822bbc9-e1cc-4514-b378-732b5e9bf27e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.1018801
Jun 02 16:46:30.452596 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:30.500735 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8211d7b3-883b-424b-a15b-c40fe1f9aca1 req-9fdcd7a7-1eaa-4e89-a7f8-36641b0f839b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428267
Jun 02 16:46:30.668568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e195be-1b4a-45d3-82f7-3db60fb0eac5 req-e42dd7ea-95e8-4909-bb7d-232d49a8a570 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:30.670312 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40e195be-1b4a-45d3-82f7-3db60fb0eac5 req-e42dd7ea-95e8-4909-bb7d-232d49a8a570 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0845742
Jun 02 16:46:30.721389 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40e195be-1b4a-45d3-82f7-3db60fb0eac5 req-e9627f46-7d63-4314-8378-e4706f12d84c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452280
Jun 02 16:46:30.831669 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679e5da2-c464-4f4f-ba25-d97191f8f42b req-ecc5cebe-8944-43f8-95d2-c8b5e6916186 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:30.833153 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-679e5da2-c464-4f4f-ba25-d97191f8f42b req-ecc5cebe-8944-43f8-95d2-c8b5e6916186 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0845311
Jun 02 16:46:30.883346 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-679e5da2-c464-4f4f-ba25-d97191f8f42b req-1a622401-75e8-433d-a8e3-269d13563dfd tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444303
Jun 02 16:46:31.360630 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6307061e-fe7b-4850-8d2c-59b93cc1b332 req-c5324a43-87a1-4c70-b6f3-e5f7eac814a1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:31.362316 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6307061e-fe7b-4850-8d2c-59b93cc1b332 req-c5324a43-87a1-4c70-b6f3-e5f7eac814a1 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0846283
Jun 02 16:46:31.412661 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6307061e-fe7b-4850-8d2c-59b93cc1b332 req-2d965f85-221c-4293-ade6-b97f60ec0f89 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0443108
Jun 02 16:46:31.701426 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce362ca-4b6e-48d3-8a37-1fef20331ec5 req-3a632b98-be0a-4931-9f5e-e0d538d08d86 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:31.703183 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1ce362ca-4b6e-48d3-8a37-1fef20331ec5 req-3a632b98-be0a-4931-9f5e-e0d538d08d86 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0890484
Jun 02 16:46:31.762705 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1ce362ca-4b6e-48d3-8a37-1fef20331ec5 req-3bf4ed8a-73a0-4192-8c20-ac2f18050b41 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0547581
Jun 02 16:46:31.858530 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:31.931106 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b20b71-20e1-4210-9b91-ba170f95a574 req-ae402daf-7169-45c2-bb7d-0f53dbd1aa2c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:31.932595 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-08b20b71-20e1-4210-9b91-ba170f95a574 req-ae402daf-7169-45c2-bb7d-0f53dbd1aa2c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0812688
Jun 02 16:46:31.987509 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-08b20b71-20e1-4210-9b91-ba170f95a574 req-9e8cc11b-e293-405e-9e79-8381e28302ce tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0488374
Jun 02 16:46:32.080993 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d3cf6c-2cf6-4456-a469-1d758d7293ef req-72896848-1ead-433d-a27e-036f08333a42 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:32.082554 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a2d3cf6c-2cf6-4456-a469-1d758d7293ef req-72896848-1ead-433d-a27e-036f08333a42 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0851691
Jun 02 16:46:32.129144 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a2d3cf6c-2cf6-4456-a469-1d758d7293ef req-871b137d-21c0-4e05-b00e-833b24767ced tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405800
Jun 02 16:46:32.600155 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eef650d-88ad-46ba-afda-398b8967328b req-0100fd32-ca27-48d6-ac56-03aff90e8883 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:32.601754 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1eef650d-88ad-46ba-afda-398b8967328b req-0100fd32-ca27-48d6-ac56-03aff90e8883 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0824771
Jun 02 16:46:32.649729 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1eef650d-88ad-46ba-afda-398b8967328b req-ce807a0c-f6c3-4fa7-8f6e-a796d565aa80 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403831
Jun 02 16:46:32.963740 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ad5007-7e54-4b48-a110-16d71e604c48 req-88d80c4d-586f-4a04-9e04-69a40e3bb423 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:32.965074 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57ad5007-7e54-4b48-a110-16d71e604c48 req-88d80c4d-586f-4a04-9e04-69a40e3bb423 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0856073
Jun 02 16:46:33.027257 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57ad5007-7e54-4b48-a110-16d71e604c48 req-86e167f6-caf2-4ab5-b1b9-637048f0e9ec tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0529175
Jun 02 16:46:33.347974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a05e23a-0335-45fc-b1b7-c198e4806383 req-22494f8a-f380-4148-8d6a-0ccb36cd2394 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:33.349524 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7a05e23a-0335-45fc-b1b7-c198e4806383 req-22494f8a-f380-4148-8d6a-0ccb36cd2394 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1024337
Jun 02 16:46:33.392067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c25ba07-4a31-48c4-83fa-63340db47e9b req-a29b55bd-5ed0-4ef2-86f3-e4352a7374fb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:33.393572 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4c25ba07-4a31-48c4-83fa-63340db47e9b req-a29b55bd-5ed0-4ef2-86f3-e4352a7374fb tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1207471
Jun 02 16:46:33.408523 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7a05e23a-0335-45fc-b1b7-c198e4806383 req-07421708-e055-4cdc-bae5-ba776045a1aa tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524473
Jun 02 16:46:33.443565 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4c25ba07-4a31-48c4-83fa-63340db47e9b req-40664729-2547-4d38-a779-5fa9dfce22f3 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424805
Jun 02 16:46:33.775344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:33.860041 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa1e2d2-f5cf-4d0c-96dd-2e35fe434448 req-87c41412-041e-44e1-b346-a92207a573cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:33.867435 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dfa1e2d2-f5cf-4d0c-96dd-2e35fe434448 req-87c41412-041e-44e1-b346-a92207a573cb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.1054504
Jun 02 16:46:33.911734 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-dfa1e2d2-f5cf-4d0c-96dd-2e35fe434448 req-c2aa119a-653b-490a-8e6a-66d357b8219c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432439
Jun 02 16:46:34.232237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb82f6b8-023e-419f-96a3-b6904dcc0ba6 req-8a5d34d5-28f9-453b-9df3-bc8bd3ba797b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:34.233717 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fb82f6b8-023e-419f-96a3-b6904dcc0ba6 req-8a5d34d5-28f9-453b-9df3-bc8bd3ba797b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0927596
Jun 02 16:46:34.282634 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fb82f6b8-023e-419f-96a3-b6904dcc0ba6 req-b8861186-1e2c-4520-b03a-964295f49964 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426486
Jun 02 16:46:34.737334 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de2153e-cd4e-447d-9678-9a3f2266a268 req-21ff88d6-b4ce-43cc-91af-ab00af078c8e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:34.738803 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2de2153e-cd4e-447d-9678-9a3f2266a268 req-21ff88d6-b4ce-43cc-91af-ab00af078c8e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1817007
Jun 02 16:46:34.769919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e348ad-2a71-46fd-b8e6-ccd60893f927 req-d8d45c9e-5b84-4c79-8850-8d159e407d16 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:34.776943 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-02e348ad-2a71-46fd-b8e6-ccd60893f927 req-d8d45c9e-5b84-4c79-8850-8d159e407d16 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.2424483
Jun 02 16:46:34.797563 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2de2153e-cd4e-447d-9678-9a3f2266a268 req-c7e65ca9-862c-4731-a1b7-3d33e502734e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0488112
Jun 02 16:46:34.829534 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-02e348ad-2a71-46fd-b8e6-ccd60893f927 req-f5fa8403-b3b4-4936-87f2-6304587becaf tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517135
Jun 02 16:46:35.114260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adab356c-0680-4bf3-b7fb-e7459762e99b req-6eb31956-56df-4558-b875-d67f9de4dbf3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:35.115812 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adab356c-0680-4bf3-b7fb-e7459762e99b req-6eb31956-56df-4558-b875-d67f9de4dbf3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0925014
Jun 02 16:46:35.162007 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adab356c-0680-4bf3-b7fb-e7459762e99b req-190568e1-5e62-4d37-a320-fdb53760c738 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401380
Jun 02 16:46:35.494510 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78b9fa6-d4d2-4297-be97-93354cbcf92c req-60ee140a-5607-4778-9269-d63a4a07d0f8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:35.496606 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b78b9fa6-d4d2-4297-be97-93354cbcf92c req-60ee140a-5607-4778-9269-d63a4a07d0f8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0976384
Jun 02 16:46:35.545860 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b78b9fa6-d4d2-4297-be97-93354cbcf92c req-eef21386-4943-4d93-b500-0c01a71dea3e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426466
Jun 02 16:46:36.004513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2122ee-8b18-48d8-8192-97058fa1b8bb req-100e9417-5afd-432e-8a58-7bcea6da0d51 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:36.006139 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0d2122ee-8b18-48d8-8192-97058fa1b8bb req-100e9417-5afd-432e-8a58-7bcea6da0d51 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0879433
Jun 02 16:46:36.034304 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9721758a-8c7f-4cf3-9a7e-158f1f6db36c req-14ee56ae-0197-49e5-adeb-31beb1c8f2e8 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:36.035868 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9721758a-8c7f-4cf3-9a7e-158f1f6db36c req-14ee56ae-0197-49e5-adeb-31beb1c8f2e8 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0846860
Jun 02 16:46:36.052619 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0d2122ee-8b18-48d8-8192-97058fa1b8bb req-128113cf-57f2-497c-864e-a92406792134 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402033
Jun 02 16:46:36.107535 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9721758a-8c7f-4cf3-9a7e-158f1f6db36c req-cc2274a2-88b6-45a0-a092-ea412e45eec8 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654616
Jun 02 16:46:36.351653 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150c5911-a0d0-4870-82c3-596de7c31e05 req-1ca72b45-cdf8-4dc2-9700-cb2c77876891 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:36.353517 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-150c5911-a0d0-4870-82c3-596de7c31e05 req-1ca72b45-cdf8-4dc2-9700-cb2c77876891 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0844123
Jun 02 16:46:36.407811 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-150c5911-a0d0-4870-82c3-596de7c31e05 req-a93316a7-f924-454f-8ed7-1233b7602982 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0479808
Jun 02 16:46:36.745748 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9871e6f-36b0-47d5-b2f3-7cf30ddc1c18 req-4f069db3-4b77-441e-b2f3-e0d7b6008b27 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:36.747287 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b9871e6f-36b0-47d5-b2f3-7cf30ddc1c18 req-4f069db3-4b77-441e-b2f3-e0d7b6008b27 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0896132
Jun 02 16:46:36.794491 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b9871e6f-36b0-47d5-b2f3-7cf30ddc1c18 req-6edb4447-3b76-4643-8756-ab7689d69551 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408895
Jun 02 16:46:37.281358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a6a619-07d4-4807-b539-3b3473515f5d req-4f1799ad-9ed4-4d43-afe7-23e0772e0d44 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.282777 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-14a6a619-07d4-4807-b539-3b3473515f5d req-4f1799ad-9ed4-4d43-afe7-23e0772e0d44 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0939035
Jun 02 16:46:37.303969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d77302-3a00-4074-a75f-c25e934331e4 req-320104ba-7d9f-4c4a-8d0c-e1e149524ed6 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.305458 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d2d77302-3a00-4074-a75f-c25e934331e4 req-320104ba-7d9f-4c4a-8d0c-e1e149524ed6 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0896933
Jun 02 16:46:37.333839 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-14a6a619-07d4-4807-b539-3b3473515f5d req-3252f2a4-83c5-4ff8-b14a-7af3c24c0c42 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444136
Jun 02 16:46:37.351246 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d2d77302-3a00-4074-a75f-c25e934331e4 req-43f8783f-6043-409f-b658-598029386fd5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398211
Jun 02 16:46:37.644292 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-5939fcd6-5e41-4cae-a9a7-7eeca3cbbfff service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 217 time: 0.0713017
Jun 02 16:46:37.724829 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb6a839-9809-41d4-a3f2-33c9c9617913 req-0c2d3aab-f940-4908-93e4-6002234ead85 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.726530 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7fb6a839-9809-41d4-a3f2-33c9c9617913 req-0c2d3aab-f940-4908-93e4-6002234ead85 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.2053630
Jun 02 16:46:37.737293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-c217d66d-e0cd-4524-9361-d5294f174fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.738835 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-c217d66d-e0cd-4524-9361-d5294f174fbe service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0881538
Jun 02 16:46:37.776237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-7cc0b2aa-9fed-45ff-a7d1-f5c79fcb15bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.777752 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-7cc0b2aa-9fed-45ff-a7d1-f5c79fcb15bd service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1099 time: 0.2004306
Jun 02 16:46:37.910179 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991ac904-cc63-405d-acd4-1de2595fa6c1 req-ffb74449-0d28-4dc7-9664-634362166261 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.911602 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-991ac904-cc63-405d-acd4-1de2595fa6c1 req-ffb74449-0d28-4dc7-9664-634362166261 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1098 time: 0.1386383
Jun 02 16:46:37.915112 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-c5a35e21-6718-4711-a72e-de8dbc3ba1bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:37.916546 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-c5a35e21-6718-4711-a72e-de8dbc3ba1bd service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1448200
Jun 02 16:46:37.950233 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-7fb6a839-9809-41d4-a3f2-33c9c9617913 req-cafdecdb-71af-40d0-bb0a-004a691478e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2145197
Jun 02 16:46:38.066518 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-57870a4a-5f3d-4386-83d4-ae3f0e016769 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.067950 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-57870a4a-5f3d-4386-83d4-ae3f0e016769 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.2546847
Jun 02 16:46:38.070598 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d218d5-34d5-461c-a4ac-af3508e8af51 req-83be265b-1312-4954-ba59-9b45fca1cca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.071878 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e7d218d5-34d5-461c-a4ac-af3508e8af51 req-83be265b-1312-4954-ba59-9b45fca1cca9 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 1098 time: 0.3002388
Jun 02 16:46:38.088394 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-991ac904-cc63-405d-acd4-1de2595fa6c1 req-0a66e96d-d672-4713-8b77-b07a131c41f6 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1699102
Jun 02 16:46:38.139100 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-c6644b94-9d94-4c68-ab89-8830d50860b8 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1789799
Jun 02 16:46:38.150404 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a679753a-79ea-4cd7-bac1-252b1e746c27 req-a48e58b6-8897-4e92-b537-5f10b87dce09 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.151832 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a679753a-79ea-4cd7-bac1-252b1e746c27 req-a48e58b6-8897-4e92-b537-5f10b87dce09 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.2391343
Jun 02 16:46:38.207610 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e7d218d5-34d5-461c-a4ac-af3508e8af51 req-55221cb9-ed84-4152-a60c-791bac6feab7 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0779448
Jun 02 16:46:38.209228 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-1feb7196-e129-482e-9b50-2a5bb48bb621 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 1001 time: 0.1268425
Jun 02 16:46:38.285796 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a679753a-79ea-4cd7-bac1-252b1e746c27 req-83049a5b-d146-45ab-bd24-e442490a1790 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1151357
Jun 02 16:46:38.311591 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b1103e99-45da-4f14-ae6f-d0cd15761acd req-4b815d0e-0f8d-4c47-a860-6d8dd042b507 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1587923
Jun 02 16:46:38.348925 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-2eaac638-12aa-46d5-be45-ee4565170411 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.350441 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-2eaac638-12aa-46d5-be45-ee4565170411 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0678742
Jun 02 16:46:38.516625 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-5e5855aa-cc33-4d84-b5e2-423a53edd065 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.518124 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-5e5855aa-cc33-4d84-b5e2-423a53edd065 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1296041
Jun 02 16:46:38.528063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-f518298f-dd99-4376-a0fb-e47ee42a919c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.529556 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-f518298f-dd99-4376-a0fb-e47ee42a919c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1096 time: 0.1293144
Jun 02 16:46:38.641096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb902d3-f34c-4615-95b3-66f281a40ed7 req-71fcc3f3-0621-4735-953a-5b853e130b10 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.642602 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7eb902d3-f34c-4615-95b3-66f281a40ed7 req-71fcc3f3-0621-4735-953a-5b853e130b10 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1780992
Jun 02 16:46:38.645742 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe1352e-cc4e-4167-b825-21d80dba23ce req-b3d68dd5-8ef1-40ea-9c62-0bbd84c794b5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.647370 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afe1352e-cc4e-4167-b825-21d80dba23ce req-b3d68dd5-8ef1-40ea-9c62-0bbd84c794b5 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.1901493
Jun 02 16:46:38.691270 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-cc804944-8cdf-4bc8-8c65-00ca07a32d43 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1643591
Jun 02 16:46:38.707625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-c82491d9-8b11-40eb-a81f-0e33c81d6e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.709093 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-c82491d9-8b11-40eb-a81f-0e33c81d6e6a service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1724191
Jun 02 16:46:38.714035 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7eb902d3-f34c-4615-95b3-66f281a40ed7 req-36a6e083-f6da-422c-8fb0-f55849cf72c9 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0597270
Jun 02 16:46:38.730992 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-afe1352e-cc4e-4167-b825-21d80dba23ce req-ec327a1e-387e-4d3b-86c8-7dd7421f98cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0764964
Jun 02 16:46:38.848214 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fe4c3218-b65c-43da-a468-d0d5a0ed7856 req-3d0d4c23-1569-4e9e-8ddb-6e5aa6a0ee67 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1436520
Jun 02 16:46:38.894052 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-60ecadbb-e6a6-4839-995b-bf6ebfa514ea service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 217 time: 0.1782069
Jun 02 16:46:38.960907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-6a59a645-4929-4c70-8eb1-02950611be64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:38.962425 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-6a59a645-4929-4c70-8eb1-02950611be64 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0613379
Jun 02 16:46:39.044120 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-b3bc5e29-4197-46e3-bef3-a3bd5dfa456d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:39.045628 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-b3bc5e29-4197-46e3-bef3-a3bd5dfa456d service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740354
Jun 02 16:46:39.384304 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef35cea2-1632-421c-bcae-572a30a81558 req-6ecfef97-8e5f-4b55-8e9f-ad4469e53e19 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:39.386370 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ef35cea2-1632-421c-bcae-572a30a81558 req-6ecfef97-8e5f-4b55-8e9f-ad4469e53e19 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.3247817
Jun 02 16:46:39.392554 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-f78358c5-e8c0-45c9-b8b6-bca178f9e846 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2870216
Jun 02 16:46:39.523688 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f174b785-aac9-4b4a-9e28-78af53b16031 req-d75d8668-8d79-4944-868b-5af5a22c9306 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:39.525260 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f174b785-aac9-4b4a-9e28-78af53b16031 req-d75d8668-8d79-4944-868b-5af5a22c9306 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.1066408
Jun 02 16:46:39.527248 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ef35cea2-1632-421c-bcae-572a30a81558 req-1f282037-794c-4c61-83af-2647b92131a3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1319709
Jun 02 16:46:39.570374 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4b3ced71-4fad-4651-bbf1-17bb051b8263 req-12e94c94-e769-464a-b28f-b9ad92c0154e service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1564329
Jun 02 16:46:39.574283 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f174b785-aac9-4b4a-9e28-78af53b16031 req-b92f065a-914b-4330-b5dc-dd338c178029 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427330
Jun 02 16:46:39.906040 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2f5c3d-a731-47bb-93da-bacbb6344725 req-c324281b-a700-43d1-865a-3b29d7030568 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:39.907540 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b2f5c3d-a731-47bb-93da-bacbb6344725 req-c324281b-a700-43d1-865a-3b29d7030568 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0847085
Jun 02 16:46:39.926660 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7a22b-d964-463d-9499-c9e4e4707ddc req-2412c4a1-98a5-40c8-9e29-654a45ad4d52 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:39.928120 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50b7a22b-d964-463d-9499-c9e4e4707ddc req-2412c4a1-98a5-40c8-9e29-654a45ad4d52 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 943 time: 0.0814123
Jun 02 16:46:39.953127 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5b2f5c3d-a731-47bb-93da-bacbb6344725 req-fe3a4281-2d20-461c-b5ba-306c57cbe383 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394514
Jun 02 16:46:39.972782 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-50b7a22b-d964-463d-9499-c9e4e4707ddc req-7ddc6d9a-8bc7-4634-968d-9daf2ada721c tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387821
Jun 02 16:46:40.112990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:46:40.146589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d790f42-2d58-4df9-aebf-cc70133f987f req-cca65288-2cd1-4dde-a423-9bb6fcd36c88 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:40.148125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8d790f42-2d58-4df9-aebf-cc70133f987f req-cca65288-2cd1-4dde-a423-9bb6fcd36c88 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0855026
Jun 02 16:46:40.195816 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8d790f42-2d58-4df9-aebf-cc70133f987f req-9428c05c-f15d-4a25-b779-c5333ebc80e8 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415158
Jun 02 16:46:40.248238 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:40.262514 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '94aba472-894e-4275-81c6-19c87819e37c', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'port_id': '94aba472-894e-4275-81c6-19c87819e37c', 'mac_address': 'fa:16:3e:44:7c:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 670, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:46:40.319321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:40.337575 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:40.353394 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:40.357724 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:40.359553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:40.465569 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=9']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:40.469231 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:40.609595 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['94aba472-894e-4275-81c6-19c87819e37c'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:40.636954 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff5e13b0-4846-4181-8f62-1bd54c080584 req-09a445a9-ff6e-4a54-95ff-67a1d1690a0d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:40.639350 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ff5e13b0-4846-4181-8f62-1bd54c080584 req-09a445a9-ff6e-4a54-95ff-67a1d1690a0d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1149614
Jun 02 16:46:40.693783 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ff5e13b0-4846-4181-8f62-1bd54c080584 req-e6949c40-0742-4656-b089-31c603a6ff3e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430088
Jun 02 16:46:40.730261 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2c35ab-f54f-431e-9e15-dd519923a397 req-818182b4-aa19-4d49-b830-9fb6f7c36d9f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:40.731803 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea2c35ab-f54f-431e-9e15-dd519923a397 req-818182b4-aa19-4d49-b830-9fb6f7c36d9f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0919547
Jun 02 16:46:40.787434 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ea2c35ab-f54f-431e-9e15-dd519923a397 req-84e5b12c-ed2b-434b-9617-264d47363bd9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423279
Jun 02 16:46:40.910936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d3faba-a2a1-4650-b733-8d8cb7b29c26 req-5ee4b747-c9a3-4291-9ad9-75ce724fe7c9 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:40.912683 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a4d3faba-a2a1-4650-b733-8d8cb7b29c26 req-5ee4b747-c9a3-4291-9ad9-75ce724fe7c9 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0796249
Jun 02 16:46:40.967751 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a4d3faba-a2a1-4650-b733-8d8cb7b29c26 req-6c7f88e9-7c8f-4d3f-867d-9ea6ee8ae329 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0490856
Jun 02 16:46:40.968107 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307fffab-6c4b-4ccc-b97a-08e2a281c5be req-cea79424-207e-4cf7-afa0-e0f0444d36b3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:40.978193 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-307fffab-6c4b-4ccc-b97a-08e2a281c5be req-cea79424-207e-4cf7-afa0-e0f0444d36b3 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0865448
Jun 02 16:46:40.978851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56520) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:40.984091 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Request body: {'floatingip': {'port_id': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:41.061367 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:41.202608 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ea2dea-c46c-409e-a26e-5ad29eae00bc req-27eb34a4-891f-4f34-ab1e-d2a5cb9c8683 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:41.203648 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-55ea2dea-c46c-409e-a26e-5ad29eae00bc req-27eb34a4-891f-4f34-ab1e-d2a5cb9c8683 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 944 time: 0.1016326
Jun 02 16:46:41.250765 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-55ea2dea-c46c-409e-a26e-5ad29eae00bc req-eba7e9c4-afde-4497-aba0-a8e808f797af tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407319
Jun 02 16:46:41.669115 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.db.resource_extend [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 02 16:46:41.764231 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:41.769745 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:41.938090 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Floating IP 045380a4-cfa0-48f7-b94a-94e1304d4484 associated. External IP: 172.27.0.190, port: 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d.
Jun 02 16:46:42.128527 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:46:42.196202 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 94aba472-894e-4275-81c6-19c87819e37c triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:42.196509 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:42.328715 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a41e53f-825b-417e-aaa1-208608725892 req-cfb9b907-cf7b-4fbb-a0f3-cf05d5338f49 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:42.330294 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a41e53f-825b-417e-aaa1-208608725892 req-cfb9b907-cf7b-4fbb-a0f3-cf05d5338f49 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.2506413
Jun 02 16:46:42.342904 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:42.375263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:42.378379 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb09b69e-18a9-4c42-9f0e-d0735badb61a" -d '{"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:42.388155 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:42.394305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:42.398774 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:42.406072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1a41e53f-825b-417e-aaa1-208608725892 req-1442c90e-1c4e-4dc1-a1a2-f57fe02f7f79 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0673845
Jun 02 16:46:42.414609 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:46:42.484966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679bbcf4-57b5-47c1-9213-827cb5a08ebe req-93a60f69-25b4-4d7b-a090-d1a9e86deef7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:42.487540 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-679bbcf4-57b5-47c1-9213-827cb5a08ebe req-93a60f69-25b4-4d7b-a090-d1a9e86deef7 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.1042056
Jun 02 16:46:42.520291 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0fba107-b06e-4536-b4ae-ea03728c360f x-openstack-request-id: req-d0fba107-b06e-4536-b4ae-ea03728c360f {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:42.520702 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-plugged", "status": "completed", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:42.521053 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d0fba107-b06e-4536-b4ae-ea03728c360f {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:42.521683 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'code': 200}
Jun 02 16:46:42.543195 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-679bbcf4-57b5-47c1-9213-827cb5a08ebe req-39a83501-128f-4578-b76d-dd394b3b7e20 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495677
Jun 02 16:46:42.557721 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=10']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:42.578229 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:42.655697 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:46:42.660608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:42.669125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:46:42.678641 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:42.679498 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3bb6d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:42.716486 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-4ace059a-451e-4cdc-8640-f5b20bc6b331 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "PUT /v2.0/floatingips/045380a4-cfa0-48f7-b94a-94e1304d4484 HTTP/1.1" status: 200  len: 991 time: 1.7364857
Jun 02 16:46:42.718263 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:42.720520 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b96c2dff-9bf8-4a66-ad86-e39589252250" -d '{"events": [{"name": "network-changed", "server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:42.805018 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4e1172-3c2e-47dd-bafe-0705eb6a9a4f req-3909569f-9dfe-4e31-b782-3e8135d46ee8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:42.806855 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6f4e1172-3c2e-47dd-bafe-0705eb6a9a4f req-3909569f-9dfe-4e31-b782-3e8135d46ee8 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1099 time: 0.0891478
Jun 02 16:46:42.855594 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6f4e1172-3c2e-47dd-bafe-0705eb6a9a4f req-eebcce3c-913f-479f-a6e9-311d41e1cdf3 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383701
Jun 02 16:46:42.882637 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:42.891111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bae29c1e-5f81-423d-9063-8acd4650bcc4 x-openstack-request-id: req-bae29c1e-5f81-423d-9063-8acd4650bcc4 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:42.891111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:42.891788 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-bae29c1e-5f81-423d-9063-8acd4650bcc4 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:42.891788 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'status': 'completed', 'code': 200}
Jun 02 16:46:43.032415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-450c3d24-2dab-474b-a111-4baf88ebfa14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.033966 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-450c3d24-2dab-474b-a111-4baf88ebfa14 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=5febf86d75284ccb9dac5e0dadffd715&device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 1098 time: 0.0868084
Jun 02 16:46:43.191271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-99189bf1-7c5c-42e4-9923-01e15147f854 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.193141 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-99189bf1-7c5c-42e4-9923-01e15147f854 service neutron] 10.222.0.20 "GET /v2.0/networks?id=715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 200  len: 912 time: 0.1522830
Jun 02 16:46:43.364990 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3bb6d0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '045380a4-cfa0-48f7-b94a-94e1304d4484', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.190', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:90:2a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:03Z', 'updated_at': '2021-06-02T16:46:41Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:43.371242 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:46:43.382087 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:43.382814 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3bb6d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:43.457343 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-6a04d976-2252-429b-ab76-ded8c80f2a76 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d HTTP/1.1" status: 200  len: 999 time: 0.2556081
Jun 02 16:46:43.536372 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-0f416567-04df-4295-87a9-ad3a98d50468 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.538386 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-0f416567-04df-4295-87a9-ad3a98d50468 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 200  len: 850 time: 0.0714231
Jun 02 16:46:43.583563 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:43.631359 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-e7252a69-e72c-422e-9cda-b5b4ab085673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.631667 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80fc10ec-a2fb-428a-a34b-4f5beb4b8721 req-0fe64493-259f-4b3a-86a1-caddb73362ab tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.633023 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-e7252a69-e72c-422e-9cda-b5b4ab085673 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=715517d1-0353-4b9d-972e-92eb6241fe32&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0860438
Jun 02 16:46:43.633172 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-80fc10ec-a2fb-428a-a34b-4f5beb4b8721 req-0fe64493-259f-4b3a-86a1-caddb73362ab tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0900073
Jun 02 16:46:43.700587 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-80fc10ec-a2fb-428a-a34b-4f5beb4b8721 req-e390399b-9f63-437d-850e-95c150ad7204 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0574183
Jun 02 16:46:43.844291 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-4206b579-57fa-443a-b97f-290b1a4ddc44 service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1996779
Jun 02 16:46:43.861769 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b79ba2f-f8fd-48bd-abcb-b0cafbb90c40 req-b9a04c19-1ec0-4847-8ceb-ac7a4c1eeb88 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:43.866356 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7b79ba2f-f8fd-48bd-abcb-b0cafbb90c40 req-b9a04c19-1ec0-4847-8ceb-ac7a4c1eeb88 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.1729960
Jun 02 16:46:44.105056 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3bb6d0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '045380a4-cfa0-48f7-b94a-94e1304d4484', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.190', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:90:2a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:03Z', 'updated_at': '2021-06-02T16:46:41Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:44.110503 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7b79ba2f-f8fd-48bd-abcb-b0cafbb90c40 req-2ec21e08-20e6-45b0-b16c-627ca4c6c822 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2395580
Jun 02 16:46:44.111788 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11197e17-189d-404d-8116-ac320fbabfd5 None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '045380a4-cfa0-48f7-b94a-94e1304d4484', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'floating_ip_address': '172.27.0.190', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'port_id': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'mac_address': 'fa:16:3e:90:2a:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:03Z', 'updated_at': '2021-06-02T16:46:41Z', 'revision_number': 1, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:46:44.130762 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b96c2dff-9bf8-4a66-ad86-e39589252250 req-295c4e3f-f2f1-4bdc-9b40-a06ccfa5f0ce service neutron] 10.222.0.20 "GET /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2624621
Jun 02 16:46:44.366764 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc00704d-c91a-47c3-8861-b034041f17ae None None] New status for floating IP 045380a4-cfa0-48f7-b94a-94e1304d4484: ACTIVE {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:46:44.906671 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba525b5-68cb-4a6c-a04b-e0c1936fdaa7 req-9f1a30ca-2418-4e75-bbc4-819bbbfa2cee tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:44.908121 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0ba525b5-68cb-4a6c-a04b-e0c1936fdaa7 req-9f1a30ca-2418-4e75-bbc4-819bbbfa2cee tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0920482
Jun 02 16:46:44.955648 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0ba525b5-68cb-4a6c-a04b-e0c1936fdaa7 req-99684716-2ea0-427d-89ad-9c08de6e2d76 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409036
Jun 02 16:46:45.330025 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8885394b-f84e-4efb-a6b0-99d9b976f03b req-47cd7b64-2a48-4735-aa31-8ff93993081f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:45.331546 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8885394b-f84e-4efb-a6b0-99d9b976f03b req-47cd7b64-2a48-4735-aa31-8ff93993081f tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.0848093
Jun 02 16:46:45.379881 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8885394b-f84e-4efb-a6b0-99d9b976f03b req-e4771446-cf39-48d5-b8f5-0fd7bc7e4129 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397501
Jun 02 16:46:46.147468 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbdd4c7-ef94-4007-8759-fd8411905695 req-08c615c5-281a-46d3-8f97-e3043249be5b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:46.148950 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acbdd4c7-ef94-4007-8759-fd8411905695 req-08c615c5-281a-46d3-8f97-e3043249be5b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0825462
Jun 02 16:46:46.157387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:46:46.201953 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-acbdd4c7-ef94-4007-8759-fd8411905695 req-c3427af4-7ff7-4b1e-8e1d-62356eda009f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0451903
Jun 02 16:46:46.298759 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:46.313678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'mac_address': 'fa:16:3e:7a:72:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 665, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:46:46.372723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:46.391046 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:46:46.412370 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:46.417675 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:46.420622 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:46.497215 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:46.500317 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:46.731971 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['4a1c5267-6d2d-4f20-832f-b6d07dd9c926'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:47.398293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c2cf7b-5786-4d84-841a-06fd4fa89777 req-7e3d548b-acef-4a99-bf05-afddb9f76952 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:47.399786 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73c2cf7b-5786-4d84-841a-06fd4fa89777 req-7e3d548b-acef-4a99-bf05-afddb9f76952 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 944 time: 0.0822830
Jun 02 16:46:47.455072 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73c2cf7b-5786-4d84-841a-06fd4fa89777 req-c0c31687-5da7-4add-a0f1-9aa52b6c779e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0471644
Jun 02 16:46:48.175103 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:46:48.254226 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:46:48.259811 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:48.260244 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:48.378424 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:48.406550 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:48.408840 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b5d9d1a-fccf-4055-b62a-ad8a7cff1287" -d '{"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-plugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:48.416607 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:48.425395 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:48.427861 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-3f8bea7f-5c2f-4eae-a9eb-da6186e3ceef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:48.465341 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de2953ad-7775-498f-9bff-bf3e95ffcab4 x-openstack-request-id: req-de2953ad-7775-498f-9bff-bf3e95ffcab4 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:48.465643 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-plugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:48.466030 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-de2953ad-7775-498f-9bff-bf3e95ffcab4 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:48.466377 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'code': 200}
Jun 02 16:46:48.498846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:48.502278 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:48.767990 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8cf9635-44f6-49ed-a8e3-315a0d3d9c29 req-bfc25395-9f7d-4a9f-9a47-09f7432f8d10 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:48.769696 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a8cf9635-44f6-49ed-a8e3-315a0d3d9c29 req-bfc25395-9f7d-4a9f-9a47-09f7432f8d10 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.1892793
Jun 02 16:46:48.799959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef3a166-f3b8-40bd-8ec7-8a450e8e2596 req-9bbf1073-d1b8-4e73-8eec-8d4165fbebae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:48.801431 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cef3a166-f3b8-40bd-8ec7-8a450e8e2596 req-9bbf1073-d1b8-4e73-8eec-8d4165fbebae service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0916376
Jun 02 16:46:48.816956 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a8cf9635-44f6-49ed-a8e3-315a0d3d9c29 req-24e9cc60-e136-430e-98ee-e443730bdb7a tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411434
Jun 02 16:46:48.846459 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cef3a166-f3b8-40bd-8ec7-8a450e8e2596 req-34d0d9d2-3381-4d56-81a9-643644b08c6d service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0374568
Jun 02 16:46:50.013242 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d339055-b1e4-4c82-abba-0649e22362a9 req-3c767597-66ec-4a7c-abfb-ec7cbaf5c518 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:50.014744 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1d339055-b1e4-4c82-abba-0649e22362a9 req-3c767597-66ec-4a7c-abfb-ec7cbaf5c518 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0833652
Jun 02 16:46:50.064280 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1d339055-b1e4-4c82-abba-0649e22362a9 req-e64cab39-c238-4cd5-ba06-29193c49db48 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414660
Jun 02 16:46:50.257735 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee1ebd1-a3fe-47b7-beb5-9b3f3beeab87 req-e5e7e774-443f-484b-b2c0-a0c7b3a2ef9e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:50.259112 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fee1ebd1-a3fe-47b7-beb5-9b3f3beeab87 req-e5e7e774-443f-484b-b2c0-a0c7b3a2ef9e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0859272
Jun 02 16:46:50.315886 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fee1ebd1-a3fe-47b7-beb5-9b3f3beeab87 req-b62dac6e-db2b-40f4-8012-9ceccdd045f7 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497305
Jun 02 16:46:50.338615 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56642) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:50.464592 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b5f33e5-5883-48c9-bb9f-d3bf30de1976 tempest-TestShelveInstance-1297144805 tempest-TestShelveInstance-1297144805-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:50.466101 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6b5f33e5-5883-48c9-bb9f-d3bf30de1976 tempest-TestShelveInstance-1297144805 tempest-TestShelveInstance-1297144805-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1093 time: 0.1265254
Jun 02 16:46:50.470366 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56646) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:50.474980 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'fixed_ip_address': '172.20.0.3'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:50.481918 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:50.486221 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Usage tracker for resource:floatingip and tenant:b110174a94dd4df89cc6dc7b34bb7170 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:50.489482 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:50.495977 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:50.508246 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for floatingip, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:50.646513 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:50.788359 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Allocated IP 172.27.0.229 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/20ce37e7-f7be-4337-9068-bc20bdc4c44d) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:50.951716 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:50.989126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:50.998300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d3a1f21d-692c-4d67-98c8-4f33c4c43d34 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:51.060206 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:51.063184 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:51.067183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:51.104427 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'Port': ['ID=20ce37e7-f7be-4337-9068-bc20bdc4c44d,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:51.109020 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:51.604857 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ccbf4b-cf6d-45d7-bd4c-f951ce024375 req-d540305f-a50c-43e4-ae68-022635fd6769 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:51.606446 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57ccbf4b-cf6d-45d7-bd4c-f951ce024375 req-d540305f-a50c-43e4-ae68-022635fd6769 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1903293
Jun 02 16:46:51.664331 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-57ccbf4b-cf6d-45d7-bd4c-f951ce024375 req-030a5e94-6711-4a7d-a1fb-e02e51a31352 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517933
Jun 02 16:46:51.701921 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56658) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:51.710395 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:51.791339 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:51.828307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b32ee554-fec3-459d-900f-89600890a84c tempest-TestMinimumBasicScenario-1783409554 tempest-TestMinimumBasicScenario-1783409554-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:51.829842 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b32ee554-fec3-459d-900f-89600890a84c tempest-TestMinimumBasicScenario-1783409554 tempest-TestMinimumBasicScenario-1783409554-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1093 time: 0.1267681
Jun 02 16:46:51.832826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56662) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:51.837278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'port_id': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'fixed_ip_address': '172.20.0.3'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:51.843375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:51.848139 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:floatingip and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:51.851525 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:51.858455 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:51.871656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for floatingip, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.010786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.016438 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.020669 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.025480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:52.141434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event updated for resources: {'Port': ['ID=20ce37e7-f7be-4337-9068-bc20bdc4c44d,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:52.146014 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:52.156321 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.169238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Allocated IP 172.27.0.65 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/679e1abc-7c4b-4e06-8857-876db1a4baf1) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:46:52.329576 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.335100 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Floating IP c3789ea7-c4ef-45a9-9f11-3d7a1fb33021 associated. External IP: 172.27.0.229, port: 4a1c5267-6d2d-4f20-832f-b6d07dd9c926.
Jun 02 16:46:52.366651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.370629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e1a6cc69-8209-4f3a-a724-0e9203c68c7f tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:52.438980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:46:52.441827 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:46:52.446400 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:46:52.476745 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'Port': ['ID=679e1abc-7c4b-4e06-8857-876db1a4baf1,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:52.483773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:52.709112 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:46:52.875384 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:52.952337 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:53.003984 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:46:53.020105 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Sync routers for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:46:53.033469 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:53.035240 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:53.035939 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b775876d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:53.099113 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6276948
Jun 02 16:46:53.099771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:53.102498 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f1cd273-6977-4aa5-b92b-e39550b61132" -d '{"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:53.159348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26cafa8b-d22d-49d2-b70b-1d0b6c8402b6 x-openstack-request-id: req-26cafa8b-d22d-49d2-b70b-1d0b6c8402b6 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:53.159899 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:53.160190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-26cafa8b-d22d-49d2-b70b-1d0b6c8402b6 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:53.160690 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'status': 'completed', 'code': 200}
Jun 02 16:46:53.199040 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:53.205511 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:53.210894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-611290ba-f959-497e-abb6-de4d000322a9 tempest-ServerRescueNegativeTestJSON-193596363 tempest-ServerRescueNegativeTestJSON-193596363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:53.233748 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:53.269905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-ce912bdb-8d58-4200-a8b5-0f8cb683d84e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:53.271344 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-ce912bdb-8d58-4200-a8b5-0f8cb683d84e service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0803876
Jun 02 16:46:53.308992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'Port': ['ID=679e1abc-7c4b-4e06-8857-876db1a4baf1,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:53.316651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:53.328228 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:53.436139 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-e6a3512d-b75e-4751-9a0f-b83bdd7acc54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:53.437877 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-e6a3512d-b75e-4751-9a0f-b83bdd7acc54 service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1605527
Jun 02 16:46:53.549061 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-d1c5dd47-4e1a-4bd4-8b1e-c11b25017d87 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 999 time: 0.1035147
Jun 02 16:46:53.606071 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Floating IP a8b703aa-a780-430d-84d0-75517296f2b5 associated. External IP: 172.27.0.65, port: c9e943c6-ac63-43f5-8ebb-c758200b9c17.
Jun 02 16:46:53.618709 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-2b5bdaab-13a9-4d48-8d35-7de8f5acf925 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:53.620177 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-2b5bdaab-13a9-4d48-8d35-7de8f5acf925 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0615044
Jun 02 16:46:53.624711 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b775876d0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'c3789ea7-c4ef-45a9-9f11-3d7a1fb33021', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'mac_address': 'fa:16:3e:7a:72:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:51Z', 'updated_at': '2021-06-02T16:46:51Z', 'revision_number': 0, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:53.630622 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Checking router: 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:46:53.641218 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:53.641870 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b775876d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:53.717929 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-0a0c9cc2-5779-476b-9cdb-ed5438d2acc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:53.720226 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-0a0c9cc2-5779-476b-9cdb-ed5438d2acc7 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0909162
Jun 02 16:46:53.873084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:53.876846 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-399a2c43-918f-47fc-8e48-220454feef37 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1465819
Jun 02 16:46:54.016044 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Router e6c14c61-82c7-4abb-8187-fce6c8e16daa has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:46:54.018350 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3f1cd273-6977-4aa5-b92b-e39550b61132 req-c47c6eac-7c93-4107-83bc-057c22af967b service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1342020
Jun 02 16:46:54.210963 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:46:54.225028 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Sync routers for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:46:54.236154 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b775876d0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'c3789ea7-c4ef-45a9-9f11-3d7a1fb33021', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'mac_address': 'fa:16:3e:7a:72:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:51Z', 'updated_at': '2021-06-02T16:46:51Z', 'revision_number': 0, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:54.238074 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:54.238261 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.239391 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77ec19d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:54.241248 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af68ee95-3a1a-48c6-b733-539ffa0c9542 None None] The sync data for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi is: [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'c3789ea7-c4ef-45a9-9f11-3d7a1fb33021', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'floating_ip_address': '172.27.0.229', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'mac_address': 'fa:16:3e:7a:72:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:51Z', 'updated_at': '2021-06-02T16:46:51Z', 'revision_number': 0, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:46:54.305762 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.4718714
Jun 02 16:46:54.306823 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:54.309161 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56674) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:54.309332 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5b67e00-35c8-4811-9629-c57cb69e2f60" -d '{"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:54.315128 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1110274165', 'description': 'tempest-secgroup-smoke-1110274165 description', 'project_id': '6dfc0270498549a6a449e9aa4beb945e'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:54.323829 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:54.340923 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:54.359167 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0c08fb1-d2e6-452c-b0c3-db720ecae8c7 x-openstack-request-id: req-b0c08fb1-d2e6-452c-b0c3-db720ecae8c7 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:54.359493 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:54.359761 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b0c08fb1-d2e6-452c-b0c3-db720ecae8c7 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:54.360190 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:46:54.361016 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.385868 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:54.390309 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:54.424131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:54.439435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:54.458763 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:54.491130 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64ffc070-1d49-4f03-91a9-e97e714e7ef2 None None] New status for floating IP c3789ea7-c4ef-45a9-9f11-3d7a1fb33021: ACTIVE {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:46:54.528493 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-afb53dd4-f461-46e1-bbc9-0967bcfa1bb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:54.530035 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-afb53dd4-f461-46e1-bbc9-0967bcfa1bb2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1098 time: 0.1367807
Jun 02 16:46:54.575925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.593961 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.601919 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-64f1ce3b-3742-4dc6-8d23-cb4bb14cc90f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:54.712577 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroup': ['ID=297b4266-9179-42a4-b735-6a5d45acd516,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:54.717079 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:54.719938 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.721178 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.4101081
Jun 02 16:46:54.724860 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56678) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:54.729971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:54.736486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:54.740582 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:54.743734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:54.746047 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-9b5acea8-1cf7-4d2b-9ac9-3d4595a9b12d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:54.748039 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-9b5acea8-1cf7-4d2b-9ac9-3d4595a9b12d service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.1961691
Jun 02 16:46:54.750761 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:54.777124 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.873783 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-5031c315-d43c-4cb2-a7d2-379663dd9194 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 998 time: 0.1144319
Jun 02 16:46:54.886011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.891222 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.893629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:54.910969 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77ec19d0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'a8b703aa-a780-430d-84d0-75517296f2b5', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'floating_ip_address': '172.27.0.65', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'port_id': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 564, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'mac_address': 'fa:16:3e:e4:a1:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:52Z', 'updated_at': '2021-06-02T16:46:52Z', 'revision_number': 0, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:54.915012 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Checking router: e6c14c61-82c7-4abb-8187-fce6c8e16daa for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:46:54.919729 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf1f1689-fee9-4e4c-af32-48b5ab52b355,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:54.925374 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:46:54.926033 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77ec19d0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:46:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:54.931158 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:54.937743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:54.939231 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2133951
Jun 02 16:46:54.942030 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56680) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:54.948235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:54.953670 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:54.957869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:54.961484 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:54.968024 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:54.989317 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.004216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-a28c26de-8e96-4c3f-aa2b-5ef31f9f2e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:55.005812 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-a28c26de-8e96-4c3f-aa2b-5ef31f9f2e26 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.1272056
Jun 02 16:46:55.059258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.065965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.068830 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-77f7c3ab-17d2-45e2-9702-e52fa13e8d7a tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:55.092632 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=69b510cb-35d0-4cfa-abd2-48bb5c35c677,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:55.098109 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:55.111875 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.115699 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-712755da-2872-4d02-87e6-8898380278b3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1702886
Jun 02 16:46:55.116845 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56682) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:55.122290 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:55.130861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:55.135608 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:55.140285 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:46:55.141499 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:55.149900 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:55.175962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.209088 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-4e2fc69e-f0c3-41b0-868c-9c4f69cd36ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:55.210760 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-4e2fc69e-f0c3-41b0-868c-9c4f69cd36ee service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1960654
Jun 02 16:46:55.283201 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.290049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.293678 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:55.320280 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ccc75dd-9add-42c1-b73b-c16e52b8dc4d,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:55.323651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:55.332961 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.337088 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b4a5e924-c71f-460c-88c7-b2fae1ed33e0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2165906
Jun 02 16:46:55.337446 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56686) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:55.343898 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:55.354177 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:55.360811 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:55.365482 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:55.372826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:55.405733 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.413331 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-cdf53978-c2da-46b7-a1df-dad83374eb48 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1928756
Jun 02 16:46:55.479619 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.485507 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.488188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:55.514096 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77f7c1ab-c5c4-4391-aba5-bf6e8bf51f73,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:55.520836 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:55.527033 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.528279 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-cde6d4c9-5c66-48b9-8cdc-e3527fb53f7d tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1896560
Jun 02 16:46:55.531667 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56688) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:55.536428 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:55.543115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:55.547646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:55.551652 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:55.558368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:55.568634 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a5b67e00-35c8-4811-9629-c57cb69e2f60 req-dea7c784-b829-4c56-9180-f07a8dc2402e service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1487520
Jun 02 16:46:55.569636 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:46:55.571534 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.securitygroups_db [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Project 6dfc0270498549a6a449e9aa4beb945e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:46:55.578389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.607061 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77ec19d0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'a8b703aa-a780-430d-84d0-75517296f2b5', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'floating_ip_address': '172.27.0.65', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'port_id': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 564, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'mac_address': 'fa:16:3e:e4:a1:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:52Z', 'updated_at': '2021-06-02T16:46:52Z', 'revision_number': 0, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:46:55.611917 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e541a2c3-a7b3-4916-b3d2-239fd38d1792 None None] The sync data for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi is: [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': 'a8b703aa-a780-430d-84d0-75517296f2b5', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'floating_ip_address': '172.27.0.65', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'port_id': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 564, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'mac_address': 'fa:16:3e:e4:a1:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:52Z', 'updated_at': '2021-06-02T16:46:52Z', 'revision_number': 0, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:46:55.657691 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.661944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.664112 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-aebffce5-e845-4aed-9e65-53d0b7184e22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:55.687645 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b32831e4-0b0f-4376-bce2-3df3ea228e39,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:55.690379 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:55.699864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.701162 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c4eacae9-c0a1-4a19-a96d-ee7e591ee7ea tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1685021
Jun 02 16:46:55.704158 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56690) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:46:55.708889 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'security_group_rule': {'security_group_id': '297b4266-9179-42a4-b735-6a5d45acd516', 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:55.715036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:46:55.719022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Usage tracker for resource:security_group_rule and tenant:6dfc0270498549a6a449e9aa4beb945e is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:46:55.722058 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:46:55.729006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:46:55.745578 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.securitygroups_db [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Project 6dfc0270498549a6a449e9aa4beb945e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 02 16:46:55.752415 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.797136 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b0497259-c85b-43de-af24-71bbe2fd3977 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.830039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.834861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694167'] for security_group_rule, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.837036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-98d2b6b7-c296-4424-8773-e80ed1e89d54 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:55.853239 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d924420e-7d19-4aa6-ae7e-84dbbb2fc606 None None] New status for floating IP a8b703aa-a780-430d-84d0-75517296f2b5: ACTIVE {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:46:55.861062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba50d5ab-ab28-4e96-86ed-05f970830642,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:55.863850 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:55.873774 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:55.878832 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-256c578c-feda-4f6f-a62c-78a669a396e2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1700039
Jun 02 16:46:56.007775 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-1f78569e-a34c-4c21-b280-6d7d8503dff6 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1110274165&fields=id&tenant_id=6dfc0270498549a6a449e9aa4beb945e HTTP/1.1" status: 200  len: 267 time: 0.0437410
Jun 02 16:46:56.103478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-2d35da5b-87d1-4e78-836c-d5af617bf8be tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:56.104951 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-2d35da5b-87d1-4e78-836c-d5af617bf8be tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0910950
Jun 02 16:46:56.116339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'port': {'security_groups': ['b27892ff-78fd-4d6d-af61-20aff85cbd99', '297b4266-9179-42a4-b735-6a5d45acd516']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:46:56.243305 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:56.614611 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:46:56.641172 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:56.647174 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:56.653079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d3f03f1-3b64-4b9f-9619-54679e26364c tempest-VolumesSnapshotTestJSON-325377 tempest-VolumesSnapshotTestJSON-325377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:46:56.661370 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:56.723965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:56.724636 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:56.726129 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-3996f53d-7585-4ede-b58b-553d75f2a7af req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "PUT /v2.0/ports/c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 981 time: 0.6148057
Jun 02 16:46:56.726674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:46:56.729901 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a" -d '{"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:46:56.752613 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=6']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:46:56.757066 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c333b75a-b629-44a8-933f-308255c16d41 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:46:56.802510 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:46:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0614ff87-a4b1-47ab-8313-b906e7107a46 x-openstack-request-id: req-0614ff87-a4b1-47ab-8313-b906e7107a46 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:46:56.802920 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:46:56.803274 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0614ff87-a4b1-47ab-8313-b906e7107a46 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:46:56.803776 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:46:56.847191 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:46:56.938959 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-eb0c04ab-4507-4ac0-9b33-22beddbc66c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:56.940425 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-eb0c04ab-4507-4ac0-9b33-22beddbc66c1 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1137 time: 0.1126754
Jun 02 16:46:56.978779 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e26de1-79c8-4d39-8b6f-dea60babb90d req-7b88e940-900e-44d1-b9da-b36909892d9f tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:56.980371 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a0e26de1-79c8-4d39-8b6f-dea60babb90d req-7b88e940-900e-44d1-b9da-b36909892d9f tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.1069541
Jun 02 16:46:57.034430 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a0e26de1-79c8-4d39-8b6f-dea60babb90d req-2826e755-9d08-4dca-9e71-9c83ba035583 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0478675
Jun 02 16:46:57.073322 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-86e6c826-8ac5-4d02-8681-df32ab6dd891 None None] Provisioning complete for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:46:57.073782 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-86e6c826-8ac5-4d02-8681-df32ab6dd891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:57.171667 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-4fd25c1f-a1e3-4d41-99e8-3dcb26081a31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:57.174168 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-4fd25c1f-a1e3-4d41-99e8-3dcb26081a31 service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.2265258
Jun 02 16:46:57.290101 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-2f6c488d-03ca-4c53-9552-8f36dd6d6322 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 1000 time: 0.1064620
Jun 02 16:46:57.361459 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-4b439d3f-963a-4b2a-b433-85c18371b2b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:57.362959 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-4b439d3f-963a-4b2a-b433-85c18371b2b8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.0644953
Jun 02 16:46:57.456131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-83b21599-87fd-4141-8224-6fa44cd029bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:46:57.457825 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-83b21599-87fd-4141-8224-6fa44cd029bf service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0871446
Jun 02 16:46:57.614003 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-4b7c664a-f393-42ac-8ed7-390f9a786a7c service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1492240
Jun 02 16:46:57.776523 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ac55d73e-8681-40c1-8a87-c2c04dabbb6a req-0b9b661b-06be-4f01-bc1c-d620ac86aee8 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1536365
Jun 02 16:46:58.479656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1d91d148-7761-4530-9853-5c6014a3d375 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:46:58.759038 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:00.209258 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:01.862047 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:03.784082 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:03.864697 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-dfc7dc74-dd61-4c76-afb6-566d354c1457 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0803363
Jun 02 16:47:04.024396 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-8aecbc43-8e22-4433-ab6f-3a43d17509f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:04.025918 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-8aecbc43-8e22-4433-ab6f-3a43d17509f6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 1099 time: 0.0808406
Jun 02 16:47:04.179845 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-f0af95e0-dafc-4d5d-9f5a-e530cab17780 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:04.181307 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-f0af95e0-dafc-4d5d-9f5a-e530cab17780 service neutron] 10.222.0.20 "GET /v2.0/networks?id=72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 200  len: 918 time: 0.1311693
Jun 02 16:47:04.288408 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-3259c610-d8ec-40bd-a1ee-f1e9ea4ecfd3 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 200  len: 1000 time: 0.0971415
Jun 02 16:47:04.357924 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-06ca18fc-9efb-4a74-9f7d-497be137b7ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:04.359374 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-06ca18fc-9efb-4a74-9f7d-497be137b7ad service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 200  len: 856 time: 0.0600600
Jun 02 16:47:04.444088 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-9d817de8-50cd-4c90-9149-80fbe037f4ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:04.445573 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-9d817de8-50cd-4c90-9149-80fbe037f4ed service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72edfd0c-8b13-49df-90c4-bff53519faeb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0730426
Jun 02 16:47:04.699118 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-4e6773e1-37fb-439e-9d85-f88dc4cf8acd service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2447646
Jun 02 16:47:04.852888 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7186497a-39e9-4b64-9dc8-5fc08381e911 req-27d25fd6-f002-4db4-bf6a-7bf5b65fc524 service neutron] 10.222.0.20 "GET /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1373534
Jun 02 16:47:22.933736 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-90cecaa6-3a2b-474b-9a8f-0eb46eaa7b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:22.935132 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-90cecaa6-3a2b-474b-9a8f-0eb46eaa7b4a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1137 time: 0.1345978
Jun 02 16:47:22.943330 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36c6a02-03a8-4570-8f91-8e26ffbf9456 req-cd915636-d83e-4c45-aa0b-d870518986a0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:22.944644 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d36c6a02-03a8-4570-8f91-8e26ffbf9456 req-cd915636-d83e-4c45-aa0b-d870518986a0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.1123786
Jun 02 16:47:23.079397 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-d36c6a02-03a8-4570-8f91-8e26ffbf9456 req-0e262c23-646c-434f-95e7-cc53977769c0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:47:23.112412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-746d4b59-b2ce-4c45-8738-2ec9be564ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:23.113960 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-746d4b59-b2ce-4c45-8738-2ec9be564ab2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.1684895
Jun 02 16:47:23.114986 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-d36c6a02-03a8-4570-8f91-8e26ffbf9456 req-0e262c23-646c-434f-95e7-cc53977769c0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:47:23.116025 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d36c6a02-03a8-4570-8f91-8e26ffbf9456 req-0e262c23-646c-434f-95e7-cc53977769c0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1531675
Jun 02 16:47:23.225722 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-ae3f23c2-a9e4-49d3-b781-7cb398c77925 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 1000 time: 0.1036263
Jun 02 16:47:23.302183 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-32892c45-ba19-469c-85b4-ccacab6b9b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:23.303718 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-32892c45-ba19-469c-85b4-ccacab6b9b81 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.0677252
Jun 02 16:47:23.393934 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-fa3528a6-db94-4ab4-ad5c-c42fff4f5d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:23.395412 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-fa3528a6-db94-4ab4-ad5c-c42fff4f5d88 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0829442
Jun 02 16:47:23.542006 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-091b0de3-3b26-4fd2-a150-f43fe4dabf63 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1382034
Jun 02 16:47:23.680668 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4a1d2275-accc-49e2-85e2-774ee3c72378 req-b7a6a25f-2b9b-427f-8591-9ae67d7a5ddf service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303518
Jun 02 16:47:24.326250 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d83413-0f7c-443b-8a0c-22a8b4e37dea req-f9f38e8a-d28f-4ea3-8ea7-21aa092d130c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:24.327699 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93d83413-0f7c-443b-8a0c-22a8b4e37dea req-f9f38e8a-d28f-4ea3-8ea7-21aa092d130c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0985632
Jun 02 16:47:24.374882 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-93d83413-0f7c-443b-8a0c-22a8b4e37dea req-fd088877-65bc-4cf4-b601-c8b70f18481f tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0412946
Jun 02 16:47:25.593649 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de51254c-d2eb-48cd-a6d6-ab39b899e524 req-e3e82de8-9662-453d-a62f-62c50ed2a2a1 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:25.595140 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de51254c-d2eb-48cd-a6d6-ab39b899e524 req-e3e82de8-9662-453d-a62f-62c50ed2a2a1 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0976071
Jun 02 16:47:25.646783 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-de51254c-d2eb-48cd-a6d6-ab39b899e524 req-c02e196c-616f-41aa-92ce-2313c6066694 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0456190
Jun 02 16:47:25.793345 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cf00d57d-ccd6-471b-bffa-2c410a0c8366 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:26.843899 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c191dd2-0e47-4f45-b8e9-d3cbfb43ed19 req-0404db82-b375-4aa2-9ad8-bc4336224e7e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:26.845350 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8c191dd2-0e47-4f45-b8e9-d3cbfb43ed19 req-0404db82-b375-4aa2-9ad8-bc4336224e7e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0800729
Jun 02 16:47:26.897820 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-8c191dd2-0e47-4f45-b8e9-d3cbfb43ed19 req-02eaa64e-9d13-49a3-b959-0c2401bbf07a tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0435684
Jun 02 16:47:28.108724 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb80aba3-862b-402a-b373-a40ff095b402 req-73e0360f-2581-4426-b8e9-d51432d47a6b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:28.110316 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fb80aba3-862b-402a-b373-a40ff095b402 req-73e0360f-2581-4426-b8e9-d51432d47a6b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0897131
Jun 02 16:47:28.159650 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fb80aba3-862b-402a-b373-a40ff095b402 req-5157e80a-8816-459e-9c6c-297a3d4ad8ae tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0422702
Jun 02 16:47:28.287039 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46dca1ff-6dec-481e-b181-fdb7ab4c17b1 req-034396ff-551a-4927-a813-93df37a4649d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:28.290614 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-46dca1ff-6dec-481e-b181-fdb7ab4c17b1 req-034396ff-551a-4927-a813-93df37a4649d tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.0813529
Jun 02 16:47:28.337845 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-46dca1ff-6dec-481e-b181-fdb7ab4c17b1 req-7b9361b3-6178-4c74-9f64-6ff2043f20de tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418136
Jun 02 16:47:28.488210 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-863fac0f-6d95-4e58-87f0-d4f7dd4dfbf5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:28.756160 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:29.363366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67423c8-8322-4a1a-a5e7-86457f7a6add req-1f542a62-a262-442b-a3bd-30093b016f3b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:29.366344 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a67423c8-8322-4a1a-a5e7-86457f7a6add req-1f542a62-a262-442b-a3bd-30093b016f3b tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0920374
Jun 02 16:47:29.418958 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a67423c8-8322-4a1a-a5e7-86457f7a6add req-701bda40-f1b4-448c-91c7-b504497e0750 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0465639
Jun 02 16:47:29.599501 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0660ac-413f-4235-96be-c22af1da2afd req-ab79b858-a099-4b71-a9bf-226c9c296a77 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:29.600955 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1f0660ac-413f-4235-96be-c22af1da2afd req-ab79b858-a099-4b71-a9bf-226c9c296a77 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.0825744
Jun 02 16:47:29.646456 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1f0660ac-413f-4235-96be-c22af1da2afd req-db73078a-9ece-43a9-9632-3e51f1e59440 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups?id=a7660676-3435-405a-af71-7fecff93a3f6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391753
Jun 02 16:47:29.785639 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-91ece3f0-e3a6-4e23-b181-3961d1b1f66e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:29.787047 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-91ece3f0-e3a6-4e23-b181-3961d1b1f66e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 946 time: 0.1888831
Jun 02 16:47:29.929451 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Deleting port 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:29.930078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.073970 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] For port 94aba472-894e-4275-81c6-19c87819e37c, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=94aba472-894e-4275-81c6-19c87819e37c,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:30.074273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.212014 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.371819 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.372182 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.372527 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Floating IP 29f29c0a-bc51-49a1-8c3f-0878ac1d1097 disassociated. External IP: 172.27.0.36, port: 94aba472-894e-4275-81c6-19c87819e37c.
Jun 02 16:47:30.372969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Calling delete_port for 94aba472-894e-4275-81c6-19c87819e37c owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:30.498154 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:30.503791 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:30.587654 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'Port': ['ID=94aba472-894e-4275-81c6-19c87819e37c,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:30.660864 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.661216 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.661641 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.662001 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.662361 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.662720 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.663079 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.663433 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.663801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.664131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.664490 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.664840 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:30.676742 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:30.802256 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a2ccaae0-1e3b-489e-9d5e-48032ada39c8 req-81e21e65-efad-4e3e-ae28-709458cf61e9 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/ports?device_id=84afab9f-76d5-4c69-8305-f3dc29798962 HTTP/1.1" status: 200  len: 210 time: 0.0421660
Jun 02 16:47:30.803158 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-748d777b-828e-43fa-9fda-424e14d34326 req-6dee2364-6303-4c10-80df-89b4913a7458 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:30.804143 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-748d777b-828e-43fa-9fda-424e14d34326 req-6dee2364-6303-4c10-80df-89b4913a7458 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.2668176
Jun 02 16:47:30.831431 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:47:30.863907 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-748d777b-828e-43fa-9fda-424e14d34326 req-c97972f7-301e-48c3-a13c-9ca8fae12ea0 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0535023
Jun 02 16:47:31.045352 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:47:31.063553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:47:31.079616 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:31.080257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1483a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:31.136731 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] No DVR routers for this DVR port 94aba472-894e-4275-81c6-19c87819e37c on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:47:31.139338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:31.142050 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-deleted', 'tag': '94aba472-894e-4275-81c6-19c87819e37c'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:47:31.144415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-448f534f-a88d-4caf-afa2-4374af6f14d9" -d '{"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-deleted", "tag": "94aba472-894e-4275-81c6-19c87819e37c"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:47:31.159080 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b6ac64a4-bb0c-4419-b557-e1c38f9b89ec req-5783b62b-7b6d-4947-816a-de86735b314b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.20 "DELETE /v2.0/ports/94aba472-894e-4275-81c6-19c87819e37c HTTP/1.1" status: 204  len: 173 time: 1.3652165
Jun 02 16:47:31.201838 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:47:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe4382a6-9063-4803-835b-672317b60ecc x-openstack-request-id: req-fe4382a6-9063-4803-835b-672317b60ecc {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:47:31.202171 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84afab9f-76d5-4c69-8305-f3dc29798962", "name": "network-vif-deleted", "tag": "94aba472-894e-4275-81c6-19c87819e37c", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:47:31.202462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-fe4382a6-9063-4803-835b-672317b60ecc {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:47:31.202896 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84afab9f-76d5-4c69-8305-f3dc29798962', 'name': 'network-vif-deleted', 'tag': '94aba472-894e-4275-81c6-19c87819e37c', 'status': 'completed', 'code': 200}
Jun 02 16:47:31.282338 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:31.615796 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1483a0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:31.620102 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:47:31.629050 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:31.629631 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1483a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:31.817939 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:31.935060 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56852) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:31.949547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.000507 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.030839 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.078521 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b224d2-015f-41d1-bd1d-b916e90f99f3 req-cec901ac-a470-4a32-a3d3-c6119c747d0a tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:32.080071 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76b224d2-015f-41d1-bd1d-b916e90f99f3 req-cec901ac-a470-4a32-a3d3-c6119c747d0a tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0930719
Jun 02 16:47:32.087674 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.092774 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a1940abe-c478-4b7d-8d05-11a6012675f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:32.108817 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7660676-3435-405a-af71-7fecff93a3f6,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:32.111331 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:32.124456 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.126544 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "DELETE /v2.0/security-groups/a7660676-3435-405a-af71-7fecff93a3f6 HTTP/1.1" status: 204  len: 168 time: 0.1897449
Jun 02 16:47:32.129113 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56854) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:32.146259 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-76b224d2-015f-41d1-bd1d-b916e90f99f3 req-07ea9eea-94b9-4f1b-b0f5-8cdc3cee9b37 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0581653
Jun 02 16:47:32.147117 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.api.v2.resource [None req-b683b2e5-b220-4982-9c5f-5d20df5fbe3b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] show failed (client error): The resource could not be found.
Jun 02 16:47:32.151419 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b683b2e5-b220-4982-9c5f-5d20df5fbe3b tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "GET /v2.0/security-groups/a7660676-3435-405a-af71-7fecff93a3f6 HTTP/1.1" status: 404  len: 347 time: 0.0179098
Jun 02 16:47:32.151591 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56856) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:32.187175 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1483a0>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:32.191334 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee6f1f0c-2030-495a-8834-adabdb023e5a None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:39:46Z', 'revision_number': 4, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'c812a3b1-038c-4274-8dfb-011532b44752', 'name': '', 'network_id': '72edfd0c-8b13-49df-90c4-bff53519faeb', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'mac_address': 'fa:16:3e:d1:a4:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_interface', 'standard_attr_id': 83, 'fixed_ips': [{'subnet_id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:44Z', 'updated_at': '2021-06-02T16:40:03Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'subnets': [{'id': '5fa6f4a1-7c91-4d10-977a-c26f520b3ec0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:47:32.407525 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c912d661-0415-4bf7-b45d-47218daa0ef9 None None] New status for floating IP 29f29c0a-bc51-49a1-8c3f-0878ac1d1097: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:47:32.409509 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:47:32.443540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 94aba472-894e-4275-81c6-19c87819e37c {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:47:32.443777 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 94aba472-894e-4275-81c6-19c87819e37c not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:47:32.480321 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Deleting port a5f8beac-6d43-4f94-b7f6-17eb4d3718e0 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:32.480615 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.595839 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.596190 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.646199 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:47:32.722290 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Calling delete_port for a5f8beac-6d43-4f94-b7f6-17eb4d3718e0 owned by network:floatingip {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:32.838135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.842598 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-15ae81dc-a4fe-4343-83b5-d73491801992 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:32.885538 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Pushing event deleted for resources: {'Port': ['ID=a5f8beac-6d43-4f94-b7f6-17eb4d3718e0,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:32.913530 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:32.978269 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks [] for floatingip, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.992438 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:32.993561 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] 10.222.0.25 "DELETE /v2.0/floatingips/29f29c0a-bc51-49a1-8c3f-0878ac1d1097 HTTP/1.1" status: 204  len: 168 time: 0.8393059
Jun 02 16:47:33.334955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98b002b-0723-4514-8294-2dc2ac69d5ac req-0cbb78ec-1c9e-4188-880e-7e4d379eaf22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:33.336456 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d98b002b-0723-4514-8294-2dc2ac69d5ac req-0cbb78ec-1c9e-4188-880e-7e4d379eaf22 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0865443
Jun 02 16:47:33.396294 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-d98b002b-0723-4514-8294-2dc2ac69d5ac req-cbf8d32d-354f-4848-a6c9-3f363081ab70 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0516987
Jun 02 16:47:33.818207 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:34.597935 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2b58ea-f18c-496e-89d9-675a7adc2ab6 req-632bcd73-5f2e-4b87-a902-c5f85abdbe7c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:34.599429 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f2b58ea-f18c-496e-89d9-675a7adc2ab6 req-632bcd73-5f2e-4b87-a902-c5f85abdbe7c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0911798
Jun 02 16:47:34.660129 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9f2b58ea-f18c-496e-89d9-675a7adc2ab6 req-c44e4e84-c961-44db-be7e-e421b6ea7259 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0535469
Jun 02 16:47:35.807764 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56890) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:35.846725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e00b73-90c3-4b17-a2ba-0becb9acb16d req-063b346c-8e9a-48b2-b427-62896bd194e4 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:35.848186 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-10e00b73-90c3-4b17-a2ba-0becb9acb16d req-063b346c-8e9a-48b2-b427-62896bd194e4 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.0812833
Jun 02 16:47:35.896221 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-10e00b73-90c3-4b17-a2ba-0becb9acb16d req-45bacd4d-2360-4f8b-bbcd-cc12cfe84537 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=297b4266-9179-42a4-b735-6a5d45acd516&id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0416796
Jun 02 16:47:36.481229 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:37.021212 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Deleting port c812a3b1-038c-4274-8dfb-011532b44752 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:37.021986 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:37.157106 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] For port c812a3b1-038c-4274-8dfb-011532b44752, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c812a3b1-038c-4274-8dfb-011532b44752,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:37.157453 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:37.284545 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Calling delete_port for c812a3b1-038c-4274-8dfb-011532b44752 owned by network:router_interface {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:37.581338 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:37.585047 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5544bcca-69a1-444b-984d-a29c7943c2c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:37.627975 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Pushing event deleted for resources: {'Port': ['ID=c812a3b1-038c-4274-8dfb-011532b44752,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:37.631210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:37.900708 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:38.384296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Router 0f4b3491-20d5-45fe-85b1-eae089a74e29 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:47:38.568412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:47:38.580754 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Sync routers for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:47:38.585098 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56912) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:38.585643 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] 10.222.0.25 "PUT /v2.0/routers/0f4b3491-20d5-45fe-85b1-eae089a74e29/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7762344
Jun 02 16:47:38.592219 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:38.592855 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77457a00>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:38.794702 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:38.845327 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:38.979165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.051651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Deleting port 5b4b432d-d952-49ef-93f0-73b1c2062489 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:39.051984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.133593 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77457a00>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104'}], 'enable_snat': True}, 'gw_port_id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:47:37Z', 'revision_number': 5, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port': {'id': '5b4b432d-d952-49ef-93f0-73b1c2062489', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:58:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:39:39Z', 'updated_at': '2021-06-02T16:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:39.137730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Checking router: 0f4b3491-20d5-45fe-85b1-eae089a74e29 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:47:39.147158 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Routers {'0f4b3491-20d5-45fe-85b1-eae089a74e29'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:39.148071 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77457a00>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['0f4b3491-20d5-45fe-85b1-eae089a74e29'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:39.265712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] For port 5b4b432d-d952-49ef-93f0-73b1c2062489, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5b4b432d-d952-49ef-93f0-73b1c2062489,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:39.265978 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.298916 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] Set router 0f4b3491-20d5-45fe-85b1-eae089a74e29 gateway port host: None {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:39.385797 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Calling delete_port for 5b4b432d-d952-49ef-93f0-73b1c2062489 owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:39.403750 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-82644050-d895-402d-8635-750f953e9ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77457a00>, [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:47:38Z', 'revision_number': 6, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:39.408190 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644050-d895-402d-8635-750f953e9ae8 None None] The sync data for ids ['0f4b3491-20d5-45fe-85b1-eae089a74e29'] in dv-cinder-794021-2-iscsi is: [{'id': '0f4b3491-20d5-45fe-85b1-eae089a74e29', 'name': 'tempest-AttachVolumeShelveTestJSON-1311662317-router', 'tenant_id': '545e33df5ea046a0bb2be1fb482f75fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:39:37Z', 'updated_at': '2021-06-02T16:47:38Z', 'revision_number': 6, 'project_id': '545e33df5ea046a0bb2be1fb482f75fb', 'gw_port_host': None}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:47:39.658672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.663758 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:39.706498 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Pushing event deleted for resources: {'Port': ['ID=5b4b432d-d952-49ef-93f0-73b1c2062489,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:39.746846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.747227 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.747626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.748022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.748302 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.748643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.748985 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.749323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.749692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.750042 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.750366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.750801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:39.778171 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c812a3b1-038c-4274-8dfb-011532b44752 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:47:39.780798 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:39.814723 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.820305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: c812a3b1-038c-4274-8dfb-011532b44752 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:47:39.820661 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c812a3b1-038c-4274-8dfb-011532b44752 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:47:39.990038 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:39.992382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.015961 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.016575 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f4b3491-20d5-45fe-85b1-eae089a74e29 {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:47:40.028789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.032340 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] 10.222.0.25 "DELETE /v2.0/routers/0f4b3491-20d5-45fe-85b1-eae089a74e29 HTTP/1.1" status: 204  len: 168 time: 1.4429355
Jun 02 16:47:40.032774 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56924) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:40.095403 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Deleting subnet 5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:47:40.098519 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.149597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.282356 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.534262 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.539630 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:40.579616 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.583326 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5fa6f4a1-7c91-4d10-977a-c26f520b3ec0,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:40.586275 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-791eb5db-30ca-4e4f-aa2f-f84b5a4c3892 None None] Network 72edfd0c-8b13-49df-90c4-bff53519faeb requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:47:40.586458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:40.589573 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a0a063e7-8d8d-43cd-9c54-f6d2e9a23240 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/5fa6f4a1-7c91-4d10-977a-c26f520b3ec0 HTTP/1.1" status: 204  len: 168 time: 0.5557771
Jun 02 16:47:40.592363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 56932) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:40.697599 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.772548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Deleting port f111f4c1-2a68-4074-82b3-e8424102bb07 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:40.772779 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.837327 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] DHCP port deletion for 72edfd0c-8b13-49df-90c4-bff53519faeb request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:47:40.874452 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] For port f111f4c1-2a68-4074-82b3-e8424102bb07, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=f111f4c1-2a68-4074-82b3-e8424102bb07,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:40.874803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.905898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Deleting port f111f4c1-2a68-4074-82b3-e8424102bb07 {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:40.906274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:40.998551 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Calling delete_port for f111f4c1-2a68-4074-82b3-e8424102bb07 owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:41.004718 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] For port f111f4c1-2a68-4074-82b3-e8424102bb07, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=f111f4c1-2a68-4074-82b3-e8424102bb07,segment=NetworkSegment(9b9e4bab-a22b-478f-b1cb-4c73b58bba52),segment_id=9b9e4bab-a22b-478f-b1cb-4c73b58bba52)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:41.005375 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.046366 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.050546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:41.162909 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Calling delete_port for f111f4c1-2a68-4074-82b3-e8424102bb07 owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:41.202859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=f111f4c1-2a68-4074-82b3-e8424102bb07,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:41.205422 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:41.207822 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] No DVR routers for this DVR port f111f4c1-2a68-4074-82b3-e8424102bb07 on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:47:41.290359 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.293857 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:41.322663 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.334850 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Pushing event deleted for resources: {'Port': ['ID=f111f4c1-2a68-4074-82b3-e8424102bb07,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:41.335200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b764388e0>,) {'filters': {'network_id': ['72edfd0c-8b13-49df-90c4-bff53519faeb']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:41.339989 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] No DVR routers for this DVR port f111f4c1-2a68-4074-82b3-e8424102bb07 on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:47:41.345626 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.345939 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.346308 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.346624 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.346947 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.347331 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.347659 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.348014 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.348336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.348621 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b764388e0>, '9b9e4bab-a22b-478f-b1cb-4c73b58bba52') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:41.348740 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.348909 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b764388e0>, '9b9e4bab-a22b-478f-b1cb-4c73b58bba52') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:41.349060 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.349367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:47:41.353387 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:41.361728 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.380684 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.387824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Releasing vlan 670 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:47:41.388207 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:47:41.401579 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:47:41.478923 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.483278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:41.499081 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.509269 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=72edfd0c-8b13-49df-90c4-bff53519faeb,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:41.513508 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:41.522206 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] 10.222.0.25 "DELETE /v2.0/networks/72edfd0c-8b13-49df-90c4-bff53519faeb HTTP/1.1" status: 204  len: 168 time: 0.9288037
Jun 02 16:47:41.650434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56938) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:41.698985 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-a4a4a1e9-4248-4055-908a-e0ab61d52b4a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=545e33df5ea046a0bb2be1fb482f75fb&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0473244
Jun 02 16:47:41.701632 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56940) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:41.762865 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.777974 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5b4b432d-d952-49ef-93f0-73b1c2062489 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:47:41.791300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.814832 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 5b4b432d-d952-49ef-93f0-73b1c2062489 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:47:41.815130 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5b4b432d-d952-49ef-93f0-73b1c2062489 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:47:41.815559 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device f111f4c1-2a68-4074-82b3-e8424102bb07 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:47:41.848443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: f111f4c1-2a68-4074-82b3-e8424102bb07 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:47:41.849151 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device f111f4c1-2a68-4074-82b3-e8424102bb07 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:47:41.849703 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.860498 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-33573cfb-f305-4673-9c4a-68f6df764091 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:41.880079 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=058e1108-bcd2-4e6f-a81d-21bf1773304c,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:41.882974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:41.884883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:41.885987 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/058e1108-bcd2-4e6f-a81d-21bf1773304c HTTP/1.1" status: 204  len: 168 time: 0.1835396
Jun 02 16:47:43.718431 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56988) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:43.838354 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:43.853124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:43.857210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Usage tracker for resource:security_group_rule and tenant:b427ee95cc2f468181509eaafa18cd02 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:43.860169 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:43.865907 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:43.948878 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:43.953930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:43.963023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-aec4632e-cb23-49e7-b2cf-b3963fdb4dc3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:44.000234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc2ad890-df04-4fbe-a209-6c94dc4caaaa,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:44.003251 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:44.005710 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-65491ae9-52db-4fb3-b18d-09a866947f92 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b427ee95cc2f468181509eaafa18cd02&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2859588
Jun 02 16:47:44.009786 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56992) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:44.069728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.095883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.156621 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.161654 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-778d558b-5d0f-414a-82cd-74a6db2dbe24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:44.172956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc2ad890-df04-4fbe-a209-6c94dc4caaaa,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:44.175509 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:44.181027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.182255 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/bc2ad890-df04-4fbe-a209-6c94dc4caaaa HTTP/1.1" status: 204  len: 168 time: 0.1716692
Jun 02 16:47:44.487187 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 56998) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:44.504477 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.518882 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:44.523000 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Usage tracker for resource:security_group_rule and tenant:d89ac02ccd1e4a248b63c6329001669a is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:44.525971 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:44.532004 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:44.616673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.622343 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.629234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8e7d1b8d-3f8d-478f-8762-749c80ae510e tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:44.668570 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d89ac02ccd1e4a248b63c6329001669a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1801991
Jun 02 16:47:44.669548 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56652602-d253-4148-9123-c226275ee47f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:44.671601 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57000) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:44.672828 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:44.732725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.758352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.812682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.816764 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-29cc4fa0-7d01-4edc-9739-7d0b1cbb322c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:44.828017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56652602-d253-4148-9123-c226275ee47f,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:44.831402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:44.834686 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:44.837671 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/56652602-d253-4148-9123-c226275ee47f HTTP/1.1" status: 204  len: 168 time: 0.1632166
Jun 02 16:47:49.951656 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57094) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:50.075266 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.091888 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:50.095893 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Usage tracker for resource:security_group_rule and tenant:4414ee276fa345d6a2a73464e502479c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:50.099082 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:50.107140 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:50.200202 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.204801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.212118 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-02e7490e-525f-44da-84d0-2530e441fe83 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:50.251208 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ff6f9ba-f84d-4aea-9034-65ffe3927831,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:50.254697 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:50.259798 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4414ee276fa345d6a2a73464e502479c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3053520
Jun 02 16:47:50.260331 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57106) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:50.319302 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.346131 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.402433 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.406596 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9037fee1-4675-40f1-86c1-1e6827b0ffa3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:50.419930 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ff6f9ba-f84d-4aea-9034-65ffe3927831,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:50.422815 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:50.436057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.439693 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4ff6f9ba-f84d-4aea-9034-65ffe3927831 HTTP/1.1" status: 204  len: 168 time: 0.1760848
Jun 02 16:47:50.746989 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57116) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:50.767457 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:50.880392 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:50.884291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Usage tracker for resource:security_group_rule and tenant:1c305c35f17b47d687d3e8a8a401cf5e is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:50.887657 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:50.894446 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:50.995161 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.000245 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.007439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-759dbc6d-3588-4ce0-ab84-1924f39aadea tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:51.047380 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1c305c35f17b47d687d3e8a8a401cf5e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2993150
Jun 02 16:47:51.048309 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9462c79b-9b25-4172-828b-ffc28599cad3,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:51.051647 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:51.052602 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57118) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:51.117266 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.143258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.195816 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.199893 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e45d1e0c-8874-4188-aa41-ebff98b6d305 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:51.211032 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9462c79b-9b25-4172-828b-ffc28599cad3,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:51.214755 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:51.218162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:51.219308 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/9462c79b-9b25-4172-828b-ffc28599cad3 HTTP/1.1" status: 204  len: 168 time: 0.1656871
Jun 02 16:47:52.425509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae745f54-2bc0-43eb-9cd7-f591da3ad5b9 req-9d1fdc95-6836-4fab-aab6-b55fec82f75e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:52.427019 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae745f54-2bc0-43eb-9cd7-f591da3ad5b9 req-9d1fdc95-6836-4fab-aab6-b55fec82f75e tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0886064
Jun 02 16:47:52.477974 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae745f54-2bc0-43eb-9cd7-f591da3ad5b9 req-b252277f-b31b-4ebf-8c09-eae8cc9c24ba tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430894
Jun 02 16:47:53.591019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57204) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:53.666700 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290e03f6-a01c-4546-a42e-edff1d027bbc req-9406295e-5d3d-4fdd-9da9-1311a229de20 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:53.668183 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-290e03f6-a01c-4546-a42e-edff1d027bbc req-9406295e-5d3d-4fdd-9da9-1311a229de20 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0837488
Jun 02 16:47:53.710285 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:53.714335 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-290e03f6-a01c-4546-a42e-edff1d027bbc req-16347034-6f82-429f-acd1-4571c23bd6ed tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups?id=dd9e62fc-8b34-4a3f-8e16-bffb722741af&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404115
Jun 02 16:47:53.725460 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:53.730033 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Usage tracker for resource:security_group_rule and tenant:fdcf84822bf84f4bb22cca50f73a7ba5 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:53.733011 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:53.738732 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:53.821703 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:53.827406 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:53.834940 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-286844aa-575d-413b-91f0-02a1f833fef7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:53.876358 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=fdcf84822bf84f4bb22cca50f73a7ba5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2842059
Jun 02 16:47:53.877436 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a7edbec-d3da-443b-8539-b38104642307,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:53.879186 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57208) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:53.880590 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:53.938744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:53.972794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.036726 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.042279 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-96e3ade9-f8f2-429c-974f-2c23536eaea4 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:54.055057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a7edbec-d3da-443b-8539-b38104642307,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:54.058562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:54.100936 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.102411 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5a7edbec-d3da-443b-8539-b38104642307 HTTP/1.1" status: 204  len: 168 time: 0.2215600
Jun 02 16:47:54.145412 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-c1cdc1af-bc8c-4857-b397-bd976aa9de0b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:47:54.147195 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-c1cdc1af-bc8c-4857-b397-bd976aa9de0b tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 945 time: 0.0840883
Jun 02 16:47:54.288368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Deleting port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:54.288708 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.393476 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57214) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:54.411017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.425531 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:47:54.427751 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] For port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:47:54.428101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.429316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Usage tracker for resource:security_group_rule and tenant:3c88d094a11e4a94923a3cd3a3b849db is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:47:54.432132 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:47:54.437995 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:47:54.536796 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.541848 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.549725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-df21c8e1-1ce9-4f4a-9e25-d9d2e3ab44a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:54.588722 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68916291-a368-4b11-a8ab-2373e830194d,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:54.591801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:54.600763 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3c88d094a11e4a94923a3cd3a3b849db&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2061245
Jun 02 16:47:54.601307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57216) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:54.658231 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.685133 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.723317 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.723895 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.724029 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Floating IP 045380a4-cfa0-48f7-b94a-94e1304d4484 disassociated. External IP: 172.27.0.190, port: 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d.
Jun 02 16:47:54.724341 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Calling delete_port for 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d owned by compute:nova {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:54.744156 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.749280 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-e5895163-9ad7-4ea0-83a3-8c7608374728 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:54.761561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68916291-a368-4b11-a8ab-2373e830194d,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:54.765649 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:54.771349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.775167 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/68916291-a368-4b11-a8ab-2373e830194d HTTP/1.1" status: 204  len: 168 time: 0.1728911
Jun 02 16:47:54.863704 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:54.869421 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:54.880877 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-91996c62-4240-46d1-a474-e05637371cb5 req-61595b34-ff36-4c0e-b56d-a07af962e6c8 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0489774
Jun 02 16:47:54.917977 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'Port': ['ID=550dbe6a-0a01-4a0d-a4d1-1aefbed2652d,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:54.921076 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:55.113892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:47:55.296754 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:47:55.312642 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:47:55.324858 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:55.325793 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3c61c0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:55.502466 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] No DVR routers for this DVR port 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d on host hv-cinder-79402 {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:47:55.505011 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:55.509058 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'name': 'network-vif-deleted', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:47:55.511408 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-846b639d-2419-4ba5-b79d-6d5c69f048e5" -d '{"events": [{"server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "name": "network-vif-deleted", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:47:55.526621 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-11e9d7d3-b85b-41f4-975c-e5d25f91f378 req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.20 "DELETE /v2.0/ports/550dbe6a-0a01-4a0d-a4d1-1aefbed2652d HTTP/1.1" status: 204  len: 173 time: 1.3716917
Jun 02 16:47:55.540170 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:55.559740 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:47:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37ce103e-8b3e-405d-a83d-d1ed9d484ace x-openstack-request-id: req-37ce103e-8b3e-405d-a83d-d1ed9d484ace {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:47:55.560209 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3e21a996-4247-41b9-b5d9-4097fa8566d6", "name": "network-vif-deleted", "tag": "550dbe6a-0a01-4a0d-a4d1-1aefbed2652d", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:47:55.560593 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-37ce103e-8b3e-405d-a83d-d1ed9d484ace {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:47:55.561168 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3e21a996-4247-41b9-b5d9-4097fa8566d6', 'name': 'network-vif-deleted', 'tag': '550dbe6a-0a01-4a0d-a4d1-1aefbed2652d', 'status': 'completed', 'code': 200}
Jun 02 16:47:55.797456 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d6d66b83-c2ec-4bf8-b099-587a30023665 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:55.874584 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3c61c0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:55.878861 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:47:55.895905 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:47:55.896538 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3c61c0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:56.075570 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ee9a0136-ad01-4eca-8da6-2a9c44a833af req-6a63dfbc-d48c-4a2e-9b31-319cee530f1f tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/ports?device_id=3e21a996-4247-41b9-b5d9-4097fa8566d6 HTTP/1.1" status: 200  len: 210 time: 0.0487242
Jun 02 16:47:56.117679 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:47:56.489452 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3c61c0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:47:56.494533 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b80b92c-9baa-4327-a154-ae2352f2341a None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:41:17Z', 'revision_number': 4, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '6cba9a0d-4163-4759-a776-8a3a131c3f51', 'name': '', 'network_id': '715517d1-0353-4b9d-972e-92eb6241fe32', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'mac_address': 'fa:16:3e:33:9f:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 306, 'fixed_ips': [{'subnet_id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:14Z', 'updated_at': '2021-06-02T16:41:26Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'subnets': [{'id': '200a3016-0d3b-4aef-b80d-de65cae94521', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:47:56.548798 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:47:56.594481 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:47:56.595134 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 550dbe6a-0a01-4a0d-a4d1-1aefbed2652d not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:47:56.779462 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dcfc9eb-de99-4647-bcb8-697fe89d6327 None None] New status for floating IP 045380a4-cfa0-48f7-b94a-94e1304d4484: DOWN {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:47:57.224237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57284) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:57.295148 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.327578 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.393959 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.399278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1751f8f7-d3bb-48c3-83c9-50e58499c7f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:57.414543 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd9e62fc-8b34-4a3f-8e16-bffb722741af,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:57.416952 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:57.422979 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.424084 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "DELETE /v2.0/security-groups/dd9e62fc-8b34-4a3f-8e16-bffb722741af HTTP/1.1" status: 204  len: 168 time: 0.1985242
Jun 02 16:47:57.426858 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57286) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:57.442072 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.api.v2.resource [None req-a4df2bf8-1ca5-4340-9fbd-f9fe66ff9b3c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] show failed (client error): The resource could not be found.
Jun 02 16:47:57.446016 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-a4df2bf8-1ca5-4340-9fbd-f9fe66ff9b3c tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "GET /v2.0/security-groups/dd9e62fc-8b34-4a3f-8e16-bffb722741af HTTP/1.1" status: 404  len: 347 time: 0.0151796
Jun 02 16:47:57.446016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57288) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:47:57.676680 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Deleting port a3702686-f2bf-414e-9a98-c379dcefb29f {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:47:57.677455 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.811467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:57.811770 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:58.032352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Calling delete_port for a3702686-f2bf-414e-9a98-c379dcefb29f owned by network:floatingip {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:47:58.147192 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:58.152879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6f3dc139-d2e8-4e01-af9e-b5d94cfda70a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:47:58.197513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Pushing event deleted for resources: {'Port': ['ID=a3702686-f2bf-414e-9a98-c379dcefb29f,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:47:58.223010 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:47:58.292256 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks [] for floatingip, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:58.306455 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:58.307590 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] 10.222.0.25 "DELETE /v2.0/floatingips/045380a4-cfa0-48f7-b94a-94e1304d4484 HTTP/1.1" status: 204  len: 168 time: 0.8609369
Jun 02 16:47:58.482891 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a417091a-f1d1-4ea3-adf2-06e868f32799 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:47:58.764697 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:00.212833 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:01.866525 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:03.796495 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:03.878732 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-fa24f06a-bd03-459c-82e5-edbc42408192 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0781257
Jun 02 16:48:03.976518 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-9855651d-46d5-49da-b537-7d681bb19276 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:03.978386 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-9855651d-46d5-49da-b537-7d681bb19276 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1099 time: 0.0760384
Jun 02 16:48:04.129092 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-dea9da06-d2ab-4432-88a9-7ef7cdca023f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:04.130503 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-dea9da06-d2ab-4432-88a9-7ef7cdca023f service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1285863
Jun 02 16:48:04.234890 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-d0e24b1a-c55b-4fe6-8e2b-da085225d8b3 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 1001 time: 0.0977952
Jun 02 16:48:04.298297 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-fb13712f-7588-4668-89fb-819510c927a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:04.299758 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-fb13712f-7588-4668-89fb-819510c927a5 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0585263
Jun 02 16:48:04.385548 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-5177f699-0cf9-420f-bfe4-aa099c67a307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:04.387125 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-5177f699-0cf9-420f-bfe4-aa099c67a307 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0801640
Jun 02 16:48:04.524718 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-e1119e75-c74b-485b-8398-6944453be043 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1307995
Jun 02 16:48:04.555238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57382) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:04.663054 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-23142f86-291c-4eb1-abf1-9098c3ccc784 req-58be5f78-c9c2-4f06-afe6-7c32ace38d63 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1309860
Jun 02 16:48:05.221252 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-81ceb28e-1fca-48da-87ed-952d23cea16c tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1074292760&fields=id&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 267 time: 0.0452797
Jun 02 16:48:05.325432 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:05.379180 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-06eb8c28-8d65-4c59-b7c5-444d1cc557df tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:05.380622 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-06eb8c28-8d65-4c59-b7c5-444d1cc557df tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.1517756
Jun 02 16:48:05.402056 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-5ed44c3c-7146-4145-ab7b-52738fb3d5af tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/quotas/2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 375 time: 0.0150433
Jun 02 16:48:05.500922 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-1e9dfda7-e7cf-4009-811a-f177caaa9443 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0980978
Jun 02 16:48:05.639679 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-b1fd0d5f-a6ab-4bf3-9266-9b3436158d3b service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1262841
Jun 02 16:48:05.737891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Deleting port 6cba9a0d-4163-4759-a776-8a3a131c3f51 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:05.738848 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:05.775606 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-0f108ddc-2fae-424c-bb97-1e143d8deaf5 service neutron] 10.222.0.25 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1296117
Jun 02 16:48:05.858548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] For port 6cba9a0d-4163-4759-a776-8a3a131c3f51, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=6cba9a0d-4163-4759-a776-8a3a131c3f51,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:05.858900 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:06.095713 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Calling delete_port for 6cba9a0d-4163-4759-a776-8a3a131c3f51 owned by network:router_interface {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:06.212896 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-177646c1-5afc-4fda-98d1-672879c9d770 req-58dd0803-afc5-41fd-976f-7147fb48cf99 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 210 time: 0.0452747
Jun 02 16:48:06.320255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:06.325674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2e9c2f8c-533a-423d-a62c-75d9ac76719f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:06.370457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Pushing event deleted for resources: {'Port': ['ID=6cba9a0d-4163-4759-a776-8a3a131c3f51,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:06.373552 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:06.690996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:07.066763 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:48:07.246837 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:48:07.255982 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Sync routers for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:48:07.262578 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] 10.222.0.25 "PUT /v2.0/routers/c5c2afbf-baf8-419d-a314-8b5a4e00c5fb/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7034655
Jun 02 16:48:07.263112 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57438) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:07.267253 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:07.267888 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3e2bb0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:07.396122 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fe8d5885-a1d3-4dbc-bda5-f5f0361dd74b req-86827bf1-9e74-4f47-8390-9122fe7afb4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 210 time: 0.0639951
Jun 02 16:48:07.452184 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:07.584102 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:07.770555 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-09cc2fa5-c88e-41f0-8390-0a0d6e8a1a2a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:07.772700 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-09cc2fa5-c88e-41f0-8390-0a0d6e8a1a2a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 810 time: 0.2966261
Jun 02 16:48:07.822401 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3e2bb0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147'}], 'enable_snat': True}, 'gw_port_id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:48:06Z', 'revision_number': 5, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port': {'id': '8718120d-fc7a-424e-a11d-097b4d3a57d0', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:38:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:07Z', 'updated_at': '2021-06-02T16:41:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:07.827257 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Checking router: c5c2afbf-baf8-419d-a314-8b5a4e00c5fb for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:48:07.837078 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Routers {'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:07.838342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:07.839180 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3e2bb0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:07.865402 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-0154c958-174e-422c-a8cc-23e40005cf72 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2be2419a57e644b38a5c0ca942660a19 HTTP/1.1" status: 200  len: 380 time: 0.0814085
Jun 02 16:48:07.884096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'port': {'device_id': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'admin_state_up': True, 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'security_groups': ['63174eef-3e33-438d-a435-e3f28b518bec']}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:07.985529 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Deleting port 8718120d-fc7a-424e-a11d-097b4d3a57d0 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:07.986287 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.029417 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] Set router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:08.067447 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:08.077954 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:08.092159 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Made reservation on behalf of 2be2419a57e644b38a5c0ca942660a19 for: {'port': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:48:08.096029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.123481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] For port 8718120d-fc7a-424e-a11d-097b4d3a57d0, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=8718120d-fc7a-424e-a11d-097b4d3a57d0,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:08.124134 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.156458 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c3e2bb0>, [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:48:07Z', 'revision_number': 6, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:08.162454 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e3fef26-8582-4bce-8c7e-048c69d3bc2f None None] The sync data for ids ['c5c2afbf-baf8-419d-a314-8b5a4e00c5fb'] in dv-cinder-794021-2-iscsi is: [{'id': 'c5c2afbf-baf8-419d-a314-8b5a4e00c5fb', 'name': 'tempest-AttachVolumeTestJSON-1982840299-router', 'tenant_id': '5febf86d75284ccb9dac5e0dadffd715', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:05Z', 'updated_at': '2021-06-02T16:48:07Z', 'revision_number': 6, 'project_id': '5febf86d75284ccb9dac5e0dadffd715', 'gw_port_host': None}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:48:08.249655 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57450) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:08.264015 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Calling delete_port for 8718120d-fc7a-424e-a11d-097b4d3a57d0 owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:08.297073 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.20.0.5 (00fea91a-5ad9-4ee8-ae53-59f9858b59ca/ca8cd98d-c3e8-45ac-8780-59a7fe077750/1b368679-537b-47da-af43-37df99edf6f8) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:48:08.475816 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.482622 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-443dba7a-d043-4429-bb20-1847b7b0e54c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:08.508872 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.541977 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:08.550096 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Usage tracker for resource:security_group_rule and tenant:83df9cb5745a4e46a0db2616dc82dd62 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:08.561910 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:08.589744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:08.634872 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Pushing event deleted for resources: {'Port': ['ID=8718120d-fc7a-424e-a11d-097b4d3a57d0,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:08.641447 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.673859 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Transition to ACTIVE for port object 1b368679-537b-47da-af43-37df99edf6f8 will not be triggered until provisioned by entity DHCP. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:48:08.754087 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:08.754582 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.756593 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.764136 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-4b245fc1-d361-4b6d-8b9d-ee21d1c39eb8 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:08.768659 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-881a051d-a985-483d-b94b-4d12266edef6 req-e2a37497-18b3-48a8-9cf0-bd29f59f068a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 210 time: 0.1776896
Jun 02 16:48:08.792349 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.820394 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.858838 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:48:08.867859 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:48:08.876481 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:48:08.913182 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=83df9cb5745a4e46a0db2616dc82dd62&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6655972
Jun 02 16:48:08.915947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57456) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:08.919274 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:08.926616 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:08.927279 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6f67f06c-0c5a-4906-9e12-802b6729d1d5 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.092s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:08.977529 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:08.978288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.984812 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=332c982b-5491-4706-8f73-481c2d342b3c,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:08.990491 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:08.992480 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d83c4e54-e80d-4131-a0ee-a5813e9689da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:08.999012 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.019928 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-6adcd0f7-5696-4747-b0bc-ff413d4cc63a tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1455095
Jun 02 16:48:09.034381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Request body: {'port': {'device_id': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:09.052144 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.052780 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Fanout notify agent at l3_agent the message router_deleted on router c5c2afbf-baf8-419d-a314-8b5a4e00c5fb {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:48:09.062971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.088637 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.089785 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] 10.222.0.25 "DELETE /v2.0/routers/c5c2afbf-baf8-419d-a314-8b5a4e00c5fb HTTP/1.1" status: 204  len: 168 time: 1.8260570
Jun 02 16:48:09.093162 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57458) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:09.128987 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.130148 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-a6985029-594f-416e-8e1b-8ae4fbbc2d93 None None] Provisioning for port 1b368679-537b-47da-af43-37df99edf6f8 completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:48:09.135079 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-a6985029-594f-416e-8e1b-8ae4fbbc2d93 None None] Provisioning complete for port 1b368679-537b-47da-af43-37df99edf6f8 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:48:09.135470 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a6985029-594f-416e-8e1b-8ae4fbbc2d93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.164801 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.191742 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Deleting subnet 200a3016-0d3b-4aef-b80d-de65cae94521 {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:48:09.195238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.205473 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-a6985029-594f-416e-8e1b-8ae4fbbc2d93 None None] Port 1b368679-537b-47da-af43-37df99edf6f8 cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:48:09.251666 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.284977 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.290701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0d70983a-e5c5-4f51-b0f2-f9cedc7b493c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:09.312818 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=332c982b-5491-4706-8f73-481c2d342b3c,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:09.316924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:09.324275 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.329246 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-7179b0af-59ff-48d2-afee-8829a28ac7b0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/332c982b-5491-4706-8f73-481c2d342b3c HTTP/1.1" status: 204  len: 168 time: 0.4088101
Jun 02 16:48:09.415509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.574771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1b368679-537b-47da-af43-37df99edf6f8 {{(pid=98278) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:48:09.582748 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.600923 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.provisioning_blocks [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Transition to ACTIVE for port object 1b368679-537b-47da-af43-37df99edf6f8 will not be triggered until provisioned by entity L2. {{(pid=98278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:48:09.606155 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:48:09.607081 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.612360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-0d2bef46-57c2-426a-a576-285cade9f0ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:09.680260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57464) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:09.707089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.738672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:09.752484 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Usage tracker for resource:security_group_rule and tenant:1bd8577db14c41aaad0130cbb8d07dcc is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:09.754150 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Pushing event updated for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:09.756976 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:09.758274 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:09.796541 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:09.873344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 6cba9a0d-4163-4759-a776-8a3a131c3f51 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:09.877029 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Attempting to bind port 1b368679-537b-47da-af43-37df99edf6f8 on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:48:09.877397 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Attempting to bind port 1b368679-537b-47da-af43-37df99edf6f8 by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:48:09.877800 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Attempting to bind port 1b368679-537b-47da-af43-37df99edf6f8 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:48:09.885750 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Port 1b368679-537b-47da-af43-37df99edf6f8 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:48:09.886063 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Attempting to bind port 1b368679-537b-47da-af43-37df99edf6f8 on network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:48:09.893318 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.893664 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 48, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:48:09.893986 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Checking segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:48:09.894368 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Bound using segment: {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'} {{(pid=98278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:48:09.895078 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.managers [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Bound port: 1b368679-537b-47da-af43-37df99edf6f8, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '335c4705-6fdd-4973-9624-acc92747502c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca'}}] {{(pid=98278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:48:09.895528 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.909813 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:09.949117 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-540fe3f6-b219-47c6-ad90-5105a69302c5 None None] Network 715517d1-0353-4b9d-972e-92eb6241fe32 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:09.949735 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:09.954934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=200a3016-0d3b-4aef-b80d-de65cae94521,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:09.965545 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:09.970140 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 6cba9a0d-4163-4759-a776-8a3a131c3f51 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:09.970489 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 6cba9a0d-4163-4759-a776-8a3a131c3f51 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:09.970662 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-77f6dd4e-77bf-4bff-aef3-473e3240f4bd admin admin] 10.222.0.25 "DELETE /v2.0/subnets/200a3016-0d3b-4aef-b80d-de65cae94521 HTTP/1.1" status: 204  len: 168 time: 0.8763242
Jun 02 16:48:09.970908 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 8718120d-fc7a-424e-a11d-097b4d3a57d0 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:09.975361 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57470) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:10.025511 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 8718120d-fc7a-424e-a11d-097b4d3a57d0 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:10.026776 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 8718120d-fc7a-424e-a11d-097b4d3a57d0 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:10.074110 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, cleared binding levels {{(pid=98278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:48:10.079283 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1b368679-537b-47da-af43-37df99edf6f8,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:48:10.094290 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.102822 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-13ea3ab3-e3dc-4dd2-9395-bd639361e4fb tempest-AttachVolumeNegativeTest-645433147 tempest-AttachVolumeNegativeTest-645433147-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:10.117209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.150561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.189016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.197684 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1ce6e242-c4bf-4fe5-8783-31b7c3e48189 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:10.264808 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1bd8577db14c41aaad0130cbb8d07dcc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5834351
Jun 02 16:48:10.267081 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb8fb653-8168-49d5-9062-787a6bf95dcf,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:10.267608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d483ff-7956-4fa3-ad92-5ed91c2cdcb8 req-b0e15d0a-062f-45ae-b300-38bab9d0a8d7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:10.268315 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-97d483ff-7956-4fa3-ad92-5ed91c2cdcb8 req-b0e15d0a-062f-45ae-b300-38bab9d0a8d7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:48:10.269542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57474) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:10.272655 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-04825886-77ca-4d11-bc69-aebdfc718327 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:10.298806 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] DHCP port deletion for 715517d1-0353-4b9d-972e-92eb6241fe32 request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:48:10.306669 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:10.307282 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.312562 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] 10.222.0.20 "PUT /v2.0/ports/1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 200  len: 1093 time: 1.2803028
Jun 02 16:48:10.312562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-97d483ff-7956-4fa3-ad92-5ed91c2cdcb8 req-b0e15d0a-062f-45ae-b300-38bab9d0a8d7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:48:10.312562 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-97d483ff-7956-4fa3-ad92-5ed91c2cdcb8 req-b0e15d0a-062f-45ae-b300-38bab9d0a8d7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.3597460
Jun 02 16:48:10.312562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:10.313300 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3" -d '{"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:10.347808 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.389594 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Deleting port e8e6a355-ea57-49f2-8fe9-4a456c023a53 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:10.390237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.413448 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-444347fe-3a38-433e-b2e7-15fa1c0e634c x-openstack-request-id: req-444347fe-3a38-433e-b2e7-15fa1c0e634c {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:10.413823 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:10.414101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-444347fe-3a38-433e-b2e7-15fa1c0e634c {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:10.415166 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8', 'status': 'completed', 'code': 200}
Jun 02 16:48:10.422090 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Deleting port e8e6a355-ea57-49f2-8fe9-4a456c023a53 {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:10.422744 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.437778 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-97d483ff-7956-4fa3-ad92-5ed91c2cdcb8 req-c17964a7-8584-4506-9ee3-3d80aca572a5 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1155601
Jun 02 16:48:10.438805 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Pushing event updated for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=3']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:10.442852 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c10ce53c-479d-46ed-8408-1b42adf7ed67 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.341s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:10.462654 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.479232 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-bb1b533e-7b30-4067-8cc7-76e70eb8a9ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:10.480786 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-bb1b533e-7b30-4067-8cc7-76e70eb8a9ad service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1096 time: 0.1208525
Jun 02 16:48:10.550554 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] For port e8e6a355-ea57-49f2-8fe9-4a456c023a53, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e8e6a355-ea57-49f2-8fe9-4a456c023a53,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:10.552159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.562237 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] For port e8e6a355-ea57-49f2-8fe9-4a456c023a53, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e8e6a355-ea57-49f2-8fe9-4a456c023a53,segment=NetworkSegment(a4855202-de9c-405c-afa8-a9d92ac32eb4),segment_id=a4855202-de9c-405c-afa8-a9d92ac32eb4)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:10.562595 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.563143 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-95c7267f-3364-4d03-9b57-86015b86cf62 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 200  len: 217 time: 0.0742121
Jun 02 16:48:10.640635 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c7ccf068-1f39-400f-82d6-fc0f41458c8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:10.642264 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-c7ccf068-1f39-400f-82d6-fc0f41458c8c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0728784
Jun 02 16:48:10.684008 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Calling delete_port for e8e6a355-ea57-49f2-8fe9-4a456c023a53 owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:10.703067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Calling delete_port for e8e6a355-ea57-49f2-8fe9-4a456c023a53 owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:10.730976 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-98809e9c-a64a-4d18-ad74-f1fbc74a2361 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:10.733832 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-98809e9c-a64a-4d18-ad74-f1fbc74a2361 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0841048
Jun 02 16:48:10.753210 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.758589 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:10.782391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.787513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af5569ce-287f-449e-990a-923d415c2e99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:10.823144 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.848428 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Pushing event deleted for resources: {'Port': ['ID=e8e6a355-ea57-49f2-8fe9-4a456c023a53,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:10.848942 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Pushing event deleted for resources: {'Port': ['ID=e8e6a355-ea57-49f2-8fe9-4a456c023a53,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:10.850843 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] No DVR routers for this DVR port e8e6a355-ea57-49f2-8fe9-4a456c023a53 on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:10.852504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:10.853240 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bb132952-f51f-4f5c-8ce9-3f0092b50552 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.019s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:10.855241 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-60d8fa83-6f72-42f0-9333-1882d7956869 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:10.862178 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] No DVR routers for this DVR port e8e6a355-ea57-49f2-8fe9-4a456c023a53 on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:10.905312 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb8fb653-8168-49d5-9062-787a6bf95dcf,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:10.912012 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:10.922378 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-1edd285b-30aa-44bc-8991-c930efbbc81f service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1812871
Jun 02 16:48:10.951513 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:10.955670 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fb8fb653-8168-49d5-9062-787a6bf95dcf HTTP/1.1" status: 204  len: 168 time: 0.6840208
Jun 02 16:48:11.037037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.051238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b767703d0>,) {'filters': {'network_id': ['715517d1-0353-4b9d-972e-92eb6241fe32']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:11.065458 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b767703d0>, 'a4855202-de9c-405c-afa8-a9d92ac32eb4') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:11.066079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b767703d0>, 'a4855202-de9c-405c-afa8-a9d92ac32eb4') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:11.115931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.122343 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-eaaabcd5-336e-403c-9fe9-9452e5a02972 req-bf0a27dd-a576-469c-84c0-bd6a207d91c4 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1888843
Jun 02 16:48:11.134101 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-44013339-151b-4fc6-b370-641f11c48c6a req-51016f5e-b0e7-45c7-8889-a9b1c057752c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1110274165&fields=id&tenant_id=6dfc0270498549a6a449e9aa4beb945e HTTP/1.1" status: 200  len: 267 time: 0.0600965
Jun 02 16:48:11.144639 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.205748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Releasing vlan 695 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:48:11.206527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   util.warn(
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   util.warn(
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   util.warn(
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   util.warn(
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:48:11.223324 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:48:11.273916 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-bbfa7f44-1abb-4dcd-8085-4153169a3cfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:11.275711 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-bbfa7f44-1abb-4dcd-8085-4153169a3cfc service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1096 time: 0.0851851
Jun 02 16:48:11.324210 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.330655 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:11.348515 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.366525 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44013339-151b-4fc6-b370-641f11c48c6a req-38f625d7-e795-41d6-b73d-d5a65154fea2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:11.368082 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-44013339-151b-4fc6-b370-641f11c48c6a req-38f625d7-e795-41d6-b73d-d5a65154fea2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 984 time: 0.2278516
Jun 02 16:48:11.368959 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Pushing event deleted for resources: {'Network': ['ID=715517d1-0353-4b9d-972e-92eb6241fe32,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:11.372714 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:11.383288 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] 10.222.0.25 "DELETE /v2.0/networks/715517d1-0353-4b9d-972e-92eb6241fe32 HTTP/1.1" status: 204  len: 168 time: 1.4042830
Jun 02 16:48:11.385916 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Request body: {'port': {'security_groups': ['b27892ff-78fd-4d6d-af61-20aff85cbd99']}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:11.482772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-df67922c-57d5-4947-aaf9-795b391e33cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:11.484920 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-df67922c-57d5-4947-aaf9-795b391e33cc service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1962252
Jun 02 16:48:11.567335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57488) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:11.593619 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-3d5c6416-94d0-4cbc-a8c1-aff41213c361 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 200  len: 217 time: 0.0988321
Jun 02 16:48:11.596601 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.651627 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57490) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:11.668398 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:11.709749 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:11.731591 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Usage tracker for resource:security_group_rule and tenant:5561d8eef6e44d46b74b2ce22b6092ca is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:11.737969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:11.753771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:11.797814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-3b109575-d600-4626-b5ba-845080373a30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:11.799318 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-3b109575-d600-4626-b5ba-845080373a30 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.1927629
Jun 02 16:48:11.828185 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e8e6a355-ea57-49f2-8fe9-4a456c023a53 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:11.868635 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-e75a71db-410a-456f-82a0-64608736d8fb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5febf86d75284ccb9dac5e0dadffd715&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2129059
Jun 02 16:48:11.874000 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: e8e6a355-ea57-49f2-8fe9-4a456c023a53 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:11.874748 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e8e6a355-ea57-49f2-8fe9-4a456c023a53 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:11.875259 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57494) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:11.967985 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c3ff54-8e93-4a32-988d-ebfb10ccf2ed req-912c26d5-4d99-4395-90fd-211edb1efccc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:11.970120 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-85c3ff54-8e93-4a32-988d-ebfb10ccf2ed req-912c26d5-4d99-4395-90fd-211edb1efccc tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.3191397
Jun 02 16:48:11.985504 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:12.024275 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.030055 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.036121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-46349662-6882-43cb-b7f1-d206210a215c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:12.042384 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:48:12.052772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.108502 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:12.108986 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.109282 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-4f7e707f-f3e2-4730-b5b5-d7930c7b4f82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:12.110870 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-4f7e707f-f3e2-4730-b5b5-d7930c7b4f82 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2914188
Jun 02 16:48:12.113795 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-44013339-151b-4fc6-b370-641f11c48c6a req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "PUT /v2.0/ports/c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 942 time: 0.7364933
Jun 02 16:48:12.114536 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:12.117158 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-119997c6-d5f9-47ef-aacd-557c9e96ad0a" -d '{"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:12.120522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57496) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:12.126890 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-85c3ff54-8e93-4a32-988d-ebfb10ccf2ed req-4e851e96-b5ff-4060-b605-47d7738d971f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1492040
Jun 02 16:48:12.128753 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.154242 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.194368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23460c5f-70a7-4f16-b33f-1d7efc4d0c65 x-openstack-request-id: req-23460c5f-70a7-4f16-b33f-1d7efc4d0c65 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:12.194692 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:12.195209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-23460c5f-70a7-4f16-b33f-1d7efc4d0c65 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:12.195641 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:48:12.207991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event updated for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=7']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:12.214304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-01e24d83-42db-4b63-bd1e-9ae4af91bb2c tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:12.222556 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:48:12.280780 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.296267 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-89e77edb-f879-4044-b012-3720645eda50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:12.326391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.369189 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5561d8eef6e44d46b74b2ce22b6092ca&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7989929
Jun 02 16:48:12.376227 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.381593 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57500) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:12.399588 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=502e336f-8df5-479c-bed1-48618adea52f,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:12.407214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5d316f64-854f-4312-8fdd-8de8f4f92b1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:12.418430 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-3fa98bb3-a98b-435e-bb77-932c70641838 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2949765
Jun 02 16:48:12.442509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-41610498-7b08-407a-a00d-9c3f8f165c50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:12.444047 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-41610498-7b08-407a-a00d-9c3f8f165c50 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1098 time: 0.2288876
Jun 02 16:48:12.459255 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-d9acd418-1a48-48be-a415-778cab622fff None None] Provisioning complete for port c9e943c6-ac63-43f5-8ebb-c758200b9c17 triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:48:12.459791 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d9acd418-1a48-48be-a415-778cab622fff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.466673 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.473775 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:12.591180 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-16c03bce-2a0c-48ea-ac39-699bc59ad5f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:12.592828 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-16c03bce-2a0c-48ea-ac39-699bc59ad5f6 service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.1412306
Jun 02 16:48:12.593932 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.599043 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-751aa93d-5a76-4fe3-9380-112a64e1d9e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:12.617400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d2dd46c-567a-4898-8c2f-7c9f820c9253,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:12.628462 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:12.683044 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=297b4266-9179-42a4-b735-6a5d45acd516,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:12.687089 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.687859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:12.705153 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.709568 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-daee56c9-b179-4c24-9676-8097796e1aec tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "DELETE /v2.0/security-groups/297b4266-9179-42a4-b735-6a5d45acd516 HTTP/1.1" status: 204  len: 168 time: 0.5425158
Jun 02 16:48:12.713069 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.713620 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57502) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:12.713845 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2d2dd46c-567a-4898-8c2f-7c9f820c9253 HTTP/1.1" status: 204  len: 168 time: 0.8307936
Jun 02 16:48:12.742406 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.757452 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-7aaaed04-fd9a-4700-95b0-e4c5bbb56aa3 req-8a13c151-d333-44c4-b74f-f1703f6a6929 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3317916
Jun 02 16:48:12.807674 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-f7b3ce18-76ed-4ef7-b842-a14f662960b5 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 1000 time: 0.1973982
Jun 02 16:48:12.811249 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.815633 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2cabf1b0-7b09-45cd-8410-4359c2254738 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:12.827234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=502e336f-8df5-479c-bed1-48618adea52f,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:12.832051 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:12.843597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:12.844753 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-2245e7d9-3b03-490e-845a-9bd8b51a6974 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/502e336f-8df5-479c-bed1-48618adea52f HTTP/1.1" status: 204  len: 168 time: 0.4622052
Jun 02 16:48:12.956500 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-8868e35f-754f-491c-aed6-12e7e317fd83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:12.957634 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-8868e35f-754f-491c-aed6-12e7e317fd83 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.1372805
Jun 02 16:48:13.107691 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-558dd17c-e275-4505-9e46-6e6f32be52f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:13.107691 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-558dd17c-e275-4505-9e46-6e6f32be52f1 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1387293
Jun 02 16:48:13.152187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Deleting port 679e1abc-7c4b-4e06-8857-876db1a4baf1 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:13.152187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.357463 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-c61b0659-b3e2-417f-a2e5-4ca7d14228ed service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2453575
Jun 02 16:48:13.365907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.366225 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.391774 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4956f6-3a80-4e0c-b9f3-49fedec9d147 req-e71d44ef-52fc-4a7f-bb7a-b6acc8d76276 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:13.393923 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ff4956f6-3a80-4e0c-b9f3-49fedec9d147 req-e71d44ef-52fc-4a7f-bb7a-b6acc8d76276 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.1067269
Jun 02 16:48:13.446767 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ff4956f6-3a80-4e0c-b9f3-49fedec9d147 req-ff0e8105-bb14-47bd-aad5-945b68853808 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467548
Jun 02 16:48:13.677049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Calling delete_port for 679e1abc-7c4b-4e06-8857-876db1a4baf1 owned by network:floatingip {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:13.795988 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-119997c6-d5f9-47ef-aacd-557c9e96ad0a req-feddf99a-3369-41bd-a738-312bb788e180 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4320629
Jun 02 16:48:13.807293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57546) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:13.905804 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.911226 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-cb8c16a9-0cbc-4158-b56a-95ec3df356cd tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:13.922113 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1468189978-network', 'tenant_id': 'e6fce23299a74f5b9fa6fbf3494ff9a5'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:13.927348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:13.931776 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Usage tracker for resource:network and tenant:e6fce23299a74f5b9fa6fbf3494ff9a5 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:13.935164 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:13.942329 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:13.953275 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Made reservation on behalf of e6fce23299a74f5b9fa6fbf3494ff9a5 for: {'network': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:48:13.954676 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event deleted for resources: {'Port': ['ID=679e1abc-7c4b-4e06-8857-876db1a4baf1,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:13.957284 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.958608 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:13.976101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:13.992516 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:13.996707 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Usage tracker for resource:security_group_rule and tenant:e6fce23299a74f5b9fa6fbf3494ff9a5 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:14.000637 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:14.006921 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:14.057867 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks [] for floatingip, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.058241 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Floating IP a8b703aa-a780-430d-84d0-75517296f2b5 disassociated (deleted). External IP: 172.27.0.65, port: c9e943c6-ac63-43f5-8ebb-c758200b9c17.
Jun 02 16:48:14.102825 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.107315 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.110454 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-1a731c8f-2f98-4009-88e2-b3a1fa139d35 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:14.138494 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] vlan segment allocate from pool success with {'vlan_id': 654, 'physical_network': 'physnet1'}  {{(pid=98278) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:48:14.147340 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92c043b2-be4a-4c57-88bc-ce8868a9b137,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:14.150953 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:14.154021 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.154624 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.segments_db [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Added segment b366f4d1-6ac2-4ab3-ba82-d244a9659676 of type vlan for network 0afd69e6-a32b-4675-94a0-286b26b2af0e
Jun 02 16:48:14.193273 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.226347 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.228091 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:14.228819 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.234023 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:14.330291 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.5211833
Jun 02 16:48:14.334951 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57594) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:14.336192 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Pushing event updated for resources: {'Network': ['ID=0afd69e6-a32b-4675-94a0-286b26b2af0e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:14.339100 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:14.341997 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Request body: {'subnet': {'network_id': '0afd69e6-a32b-4675-94a0-286b26b2af0e', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1468189978-subnet', 'tenant_id': 'e6fce23299a74f5b9fa6fbf3494ff9a5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:14.355154 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 0afd69e6-a32b-4675-94a0-286b26b2af0e details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:48:14.355747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:14.363419 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Usage tracker for resource:subnet and tenant:e6fce23299a74f5b9fa6fbf3494ff9a5 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:14.368165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:14.426478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:14.460253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Made reservation on behalf of e6fce23299a74f5b9fa6fbf3494ff9a5 for: {'subnet': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:48:14.462788 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12253020'] for subnet, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:14.565557 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Router e6c14c61-82c7-4abb-8187-fce6c8e16daa has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:48:15.094631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:48:15.107502 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Sync routers for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:48:15.117993 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997ea9aa-1290-4556-819c-394458e08d0e req-22a2f6fd-4def-4555-aa70-eedf76440481 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:15.118414 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:15.119063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b67f0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:15.121630 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-997ea9aa-1290-4556-819c-394458e08d0e req-22a2f6fd-4def-4555-aa70-eedf76440481 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.4649537
Jun 02 16:48:15.214725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:15.240923 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-997ea9aa-1290-4556-819c-394458e08d0e req-39757430-46e6-4025-8d78-7adb47c4d161 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1093187
Jun 02 16:48:15.309475 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:15.420219 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "DELETE /v2.0/floatingips/a8b703aa-a780-430d-84d0-75517296f2b5 HTTP/1.1" status: 204  len: 168 time: 2.7097437
Jun 02 16:48:15.421112 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:15.423506 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfd1b554-9f73-439d-9cde-44447fbb16e4" -d '{"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:15.485094 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57146097-2a93-41f9-8848-2325c61dc11d x-openstack-request-id: req-57146097-2a93-41f9-8848-2325c61dc11d {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:15.485538 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:15.485942 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-57146097-2a93-41f9-8848-2325c61dc11d {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:15.486465 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:48:15.642747 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-4ec5edff-8528-46ff-ab86-86918f0cf5dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:15.645989 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-4ec5edff-8528-46ff-ab86-86918f0cf5dc service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=6dfc0270498549a6a449e9aa4beb945e&device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 1098 time: 0.1352158
Jun 02 16:48:15.677047 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-11421082', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12253006'] for subnet, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:15.688402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9221c0a4-900e-4e9c-90c3-3496f14fe648 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:15.706390 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b67f0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:15.706390 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Checking router: e6c14c61-82c7-4abb-8187-fce6c8e16daa for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:48:15.713482 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:15.714167 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b67f0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:15.838791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Pushing event updated for resources: {'Subnet': ['ID=6fe769e1-8f28-4d37-81f6-1cc3d62b31f4,revision_number=0']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:15.859598 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:15.888224 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Checking segment: {'id': 'b366f4d1-6ac2-4ab3-ba82-d244a9659676', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': '0afd69e6-a32b-4675-94a0-286b26b2af0e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:48:15.888572 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Network hostable DHCP agents. Network: 0afd69e6-a32b-4675-94a0-286b26b2af0e, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98277) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:48:15.891863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-c6de2960-1b06-4e8c-a975-6412768ef650 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:15.893746 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-c6de2960-1b06-4e8c-a975-6412768ef650 service neutron] 10.222.0.20 "GET /v2.0/networks?id=51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 200  len: 916 time: 0.2399065
Jun 02 16:48:15.968370 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-058f619e-6ed9-49ef-888b-d2f9a173fdb4 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 200  len: 217 time: 0.0676363
Jun 02 16:48:15.973528 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Network 0afd69e6-a32b-4675-94a0-286b26b2af0e is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98277) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:48:15.996020 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:16.024053 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 0afd69e6-a32b-4675-94a0-286b26b2af0e) {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:48:16.042388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:16.042982 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:16.048328 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7883d7bb-8e08-41ad-a7db-4ca40fd343a9 None None] Network 0afd69e6-a32b-4675-94a0-286b26b2af0e requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:16.062303 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-58867ab1-860c-42e2-9d2f-faf514159ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:16.064081 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-58867ab1-860c-42e2-9d2f-faf514159ef8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 200  len: 854 time: 0.0859249
Jun 02 16:48:16.069036 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b4ab07e1-4062-4f37-b540-7f2a9d61da9e admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.7330046
Jun 02 16:48:16.163255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-11fa03a7-affd-404b-8220-8a94ab0a11ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:16.164798 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-11fa03a7-affd-404b-8220-8a94ab0a11ca service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=51db2abb-3ad8-4a20-b616-e97be139cc03&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0822415
Jun 02 16:48:16.355024 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-425543ab-4295-4dba-893f-9a99e2c23c6c service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1824262
Jun 02 16:48:16.529880 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6ca0386-c27a-419c-a141-3711e1ef6014 None None] Network 0afd69e6-a32b-4675-94a0-286b26b2af0e requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:16.564243 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160eec54-6df9-45db-9cfe-ffd259996f87 req-e4d426ea-2d44-4286-a0b2-2649e75537c2 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:16.567163 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-160eec54-6df9-45db-9cfe-ffd259996f87 req-e4d426ea-2d44-4286-a0b2-2649e75537c2 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.1455653
Jun 02 16:48:16.573414 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bfd1b554-9f73-439d-9cde-44447fbb16e4 req-64ce3c9d-81f0-42ba-a8db-4ff3bd45f837 service neutron] 10.222.0.20 "GET /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2071562
Jun 02 16:48:16.636542 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-160eec54-6df9-45db-9cfe-ffd259996f87 req-1e444bec-21e8-4e39-9770-b4b26551a8a5 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0618777
Jun 02 16:48:16.741233 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57644) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:16.747124 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1016527975-network', 'tenant_id': '5ecd670a034341999dda6ae2d49787d1'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:16.752209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:16.756839 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Usage tracker for resource:network and tenant:5ecd670a034341999dda6ae2d49787d1 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:16.760279 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:16.768347 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:16.776119 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1b67f0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:16.780926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Made reservation on behalf of 5ecd670a034341999dda6ae2d49787d1 for: {'network': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:48:16.783706 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3560732'] for network, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:16.786589 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d3eabe-5c86-4532-b870-bb07e32b488a None None] The sync data for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi is: [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:25Z', 'revision_number': 4, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '99e53edd-801f-43ae-b33e-b76333967555', 'name': '', 'network_id': '51db2abb-3ad8-4a20-b616-e97be139cc03', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'mac_address': 'fa:16:3e:f2:16:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_interface', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:46Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'subnets': [{'id': '49ee6390-6171-4f16-99cc-b1c7e54d783e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:48:16.799464 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:16.819689 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:16.828165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Usage tracker for resource:security_group_rule and tenant:5ecd670a034341999dda6ae2d49787d1 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:16.831683 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:16.838016 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:16.954477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:16.962246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:16.966913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-38a37767-5458-49fb-ab8f-a7cc8acf0fa4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:16.993144 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] vlan segment allocate from pool success with {'vlan_id': 667, 'physical_network': 'physnet1'}  {{(pid=98277) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 02 16:48:17.007883 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78588329-2fee-4c28-925f-fda0b6d1ea8b,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:17.011445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:17.015117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.015698 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.segments_db [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Added segment f34acfff-02fb-4502-8193-8e6d63d3ae51 of type vlan for network 022ff218-8177-479f-be6f-d5a1ebe9becd
Jun 02 16:48:17.052364 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769112217200'] for network, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.064862 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7356ca3-01b5-4b74-b2c2-05a0b4d3da5e None None] New status for floating IP a8b703aa-a780-430d-84d0-75517296f2b5: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:48:17.086910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841'] for network, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.088675 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:17.089330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.094702 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:17.190716 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.4480762
Jun 02 16:48:17.197047 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Pushing event updated for resources: {'Network': ['ID=022ff218-8177-479f-be6f-d5a1ebe9becd,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:17.198499 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57654) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:17.201065 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90f83a1c-416d-4ca3-a2af-6cf62adb4f75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:17.203675 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Request body: {'subnet': {'network_id': '022ff218-8177-479f-be6f-d5a1ebe9becd', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1016527975-subnet', 'tenant_id': '5ecd670a034341999dda6ae2d49787d1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:17.209124 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Network 022ff218-8177-479f-be6f-d5a1ebe9becd details requested by agent ovs-agent-dv-cinder-794021-2-iscsi with host dv-cinder-794021-2-iscsi {{(pid=98279) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 02 16:48:17.209292 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:17.213458 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Usage tracker for resource:subnet and tenant:5ecd670a034341999dda6ae2d49787d1 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:17.216452 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:17.222323 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:17.234750 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Made reservation on behalf of 5ecd670a034341999dda6ae2d49787d1 for: {'subnet': 1} {{(pid=98278) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:48:17.238564 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7264746'] for subnet, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.683774 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1740471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7264760'] for subnet, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.688143 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-91ba255e-fdf2-47c1-900e-743d835f61f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:17.769904 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8f97891c-5ccb-442f-a224-0ab3592f7c4b,revision_number=0']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:17.773722 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:17.776407 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Checking segment: {'id': 'f34acfff-02fb-4502-8193-8e6d63d3ae51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 667, 'network_id': '022ff218-8177-479f-be6f-d5a1ebe9becd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:48:17.776772 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Network hostable DHCP agents. Network: 022ff218-8177-479f-be6f-d5a1ebe9becd, hostable agents: ['f1da7719-5980-4ca1-92e0-99e91d643284'], hosted agents: [] {{(pid=98278) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 02 16:48:17.794870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Network 022ff218-8177-479f-be6f-d5a1ebe9becd is scheduled to be hosted by DHCP agent f1da7719-5980-4ca1-92e0-99e91d643284 with binding_index 1 {{(pid=98278) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 02 16:48:17.805434 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-794021-2-iscsi, 022ff218-8177-479f-be6f-d5a1ebe9becd) {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:48:17.815511 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:17.816103 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:17.817564 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97d721f7-afe5-4d03-b9c3-12a7f82d94d4 None None] Network 022ff218-8177-479f-be6f-d5a1ebe9becd requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:17.841911 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 0.6421521
Jun 02 16:48:17.846922 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7116359-a7dc-48b3-901b-21f5794e8f10 req-cca65200-77b0-4bb0-8cfb-949c2d8d6785 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:17.848463 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e7116359-a7dc-48b3-901b-21f5794e8f10 req-cca65200-77b0-4bb0-8cfb-949c2d8d6785 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.0876322
Jun 02 16:48:17.900579 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e7116359-a7dc-48b3-901b-21f5794e8f10 req-dd3f22f8-fca3-4923-a227-67beb892799e tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442312
Jun 02 16:48:18.016566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57666) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:18.061204 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021e37da-6b4d-478b-bd1d-a1968ce23a62 None None] Network 022ff218-8177-479f-be6f-d5a1ebe9becd requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:18.080256 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Deleting subnet 6fe769e1-8f28-4d37-81f6-1cc3d62b31f4 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:48:18.083624 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.140072 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.195649 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.463303 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.467366 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-21cf818d-c5ff-4113-a07b-22ee18a36ce3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:18.503422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6fe769e1-8f28-4d37-81f6-1cc3d62b31f4,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:18.505541 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:18.506566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.516699 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ab51b2dc-199e-4297-b281-7e6f730dacce admin admin] 10.222.0.25 "DELETE /v2.0/subnets/6fe769e1-8f28-4d37-81f6-1cc3d62b31f4 HTTP/1.1" status: 204  len: 168 time: 0.4955449
Jun 02 16:48:18.517223 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57672) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:18.727476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.855435 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.867885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7aa5d1c0>,) {'filters': {'network_id': ['0afd69e6-a32b-4675-94a0-286b26b2af0e']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:18.881214 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7aa5d1c0>, 'b366f4d1-6ac2-4ab3-ba82-d244a9659676') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:18.881485 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7aa5d1c0>, 'b366f4d1-6ac2-4ab3-ba82-d244a9659676') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:18.890409 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 1b368679-537b-47da-af43-37df99edf6f8 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:48:18.893382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-a31da84e-1c91-4ae9-aceb-9ccd6b29f13e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:18.894375 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.894704 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-a31da84e-1c91-4ae9-aceb-9ccd6b29f13e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:48:18.911861 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.914708 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-a31da84e-1c91-4ae9-aceb-9ccd6b29f13e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:48:18.919040 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Releasing vlan 654 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:48:18.919724 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:18.921544 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-a31da84e-1c91-4ae9-aceb-9ccd6b29f13e tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1132076
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:48:18.935597 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:48:18.964936 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-f49500d3-ee95-471a-8a8d-8ac52450b091 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Synchronizing usage tracker for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:48:18.983962 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-f49500d3-ee95-471a-8a8d-8ac52450b091 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Unset dirty status for tenant:6dfc0270498549a6a449e9aa4beb945e on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:48:18.994026 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b0acdc2b-3f0a-4c84-9af5-e810853776c4 req-f49500d3-ee95-471a-8a8d-8ac52450b091 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0714741
Jun 02 16:48:19.037037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.044739 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1b368679-537b-47da-af43-37df99edf6f8,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:19.045685 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-277e178a-5496-4eb1-bbd5-89cc1810f212 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:19.059005 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '1b368679-537b-47da-af43-37df99edf6f8', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'port_id': '1b368679-537b-47da-af43-37df99edf6f8', 'mac_address': 'fa:16:3e:0c:a7:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 688, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:48:19.061643 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.101783 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] 10.222.0.25 "DELETE /v2.0/networks/0afd69e6-a32b-4675-94a0-286b26b2af0e HTTP/1.1" status: 204  len: 168 time: 0.5833497
Jun 02 16:48:19.106602 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57682) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:19.108230 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Pushing event deleted for resources: {'Network': ['ID=0afd69e6-a32b-4675-94a0-286b26b2af0e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:19.115933 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c2eda255-fd87-460e-86d6-2202e17b78a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:19.130327 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.151570 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1b368679-537b-47da-af43-37df99edf6f8 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:48:19.164390 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e37c1d05-dc5f-4f18-b7b0-518a7e1f2e31 req-ce884897-0254-493f-8afa-67b541fd90eb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:19.166088 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e37c1d05-dc5f-4f18-b7b0-518a7e1f2e31 req-ce884897-0254-493f-8afa-67b541fd90eb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 943 time: 0.1063452
Jun 02 16:48:19.169005 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1b368679-537b-47da-af43-37df99edf6f8,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:19.174265 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.176136 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:19.195051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Deleting subnet 8f97891c-5ccb-442f-a224-0ab3592f7c4b {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:48:19.198859 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.216936 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e37c1d05-dc5f-4f18-b7b0-518a7e1f2e31 req-d0d308d7-959b-4f6d-954e-b23f1e5e66e1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435524
Jun 02 16:48:19.259260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.260604 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:19.264266 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:19.316679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.464673 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['1b368679-537b-47da-af43-37df99edf6f8'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:48:19.684880 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.689657 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-40c8729c-ee16-4d15-9092-cddb50b51a63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:19.724305 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8f97891c-5ccb-442f-a224-0ab3592f7c4b,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:19.729783 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:19.731464 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.740611 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57684) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:19.741108 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] 10.222.0.25 "DELETE /v2.0/subnets/8f97891c-5ccb-442f-a224-0ab3592f7c4b HTTP/1.1" status: 204  len: 168 time: 0.6263444
Jun 02 16:48:19.847439 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.985346 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:19.998578 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7a74c850>,) {'filters': {'network_id': ['022ff218-8177-479f-be6f-d5a1ebe9becd']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:20.013163 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7a74c850>, 'f34acfff-02fb-4502-8193-8e6d63d3ae51') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:20.013538 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7a74c850>, 'f34acfff-02fb-4502-8193-8e6d63d3ae51') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:20.026237 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.043390 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.050324 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Releasing vlan 667 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:48:20.050728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:48:20.064241 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:48:20.156651 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.161117 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:20.179271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.183328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae35e8b2-34e6-462b-b389-39cc0994cd48 req-71f15b52-baa8-4f2b-939f-466d1477d4a2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:20.185015 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae35e8b2-34e6-462b-b389-39cc0994cd48 req-71f15b52-baa8-4f2b-939f-466d1477d4a2 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0893974
Jun 02 16:48:20.189521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Pushing event deleted for resources: {'Network': ['ID=022ff218-8177-479f-be6f-d5a1ebe9becd,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:20.194490 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] 10.222.0.25 "DELETE /v2.0/networks/022ff218-8177-479f-be6f-d5a1ebe9becd HTTP/1.1" status: 204  len: 168 time: 0.4505758
Jun 02 16:48:20.194490 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c44e413a-4acf-4b43-89a3-bf10a78362ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:20.242300 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-ae35e8b2-34e6-462b-b389-39cc0994cd48 req-a4324c7f-09bc-488a-96b9-2516bf2f7fbf tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501037
Jun 02 16:48:20.412566 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57694) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:20.419804 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cba7124-47bc-409c-854e-5f8541910b03 req-ea4b84c6-2345-470b-a7ff-377698209d23 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:20.425659 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9cba7124-47bc-409c-854e-5f8541910b03 req-ea4b84c6-2345-470b-a7ff-377698209d23 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 944 time: 0.0893798
Jun 02 16:48:20.463201 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-7eb91eb4-6411-4b05-b706-868fc02f73bb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e6fce23299a74f5b9fa6fbf3494ff9a5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0493000
Jun 02 16:48:20.466377 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57696) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:20.471019 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9cba7124-47bc-409c-854e-5f8541910b03 req-234a0f16-47ec-4a74-b1b0-4a86529425fb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416842
Jun 02 16:48:20.534375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.560110 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.615126 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.619059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-33eb0e50-8e69-453b-bd7d-a18e507ca32b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:20.630646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92c043b2-be4a-4c57-88bc-ce8868a9b137,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:20.634353 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:20.638462 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.639680 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-accbc902-8d92-44f3-99b9-1ff754d9ad36 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/92c043b2-be4a-4c57-88bc-ce8868a9b137 HTTP/1.1" status: 204  len: 168 time: 0.1723950
Jun 02 16:48:20.798951 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-758939e4-a33c-4edc-b824-5dbd71a64bf3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:20.801798 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-758939e4-a33c-4edc-b824-5dbd71a64bf3 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.20 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.0862103
Jun 02 16:48:20.891575 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 1b368679-537b-47da-af43-37df99edf6f8 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:48:20.959907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Deleting port c9e943c6-ac63-43f5-8ebb-c758200b9c17 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:20.960771 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:20.978270 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 1b368679-537b-47da-af43-37df99edf6f8 completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:48:20.983599 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 1b368679-537b-47da-af43-37df99edf6f8 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:48:20.984159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.083839 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57702) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:21.131903 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.134314 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] For port c9e943c6-ac63-43f5-8ebb-c758200b9c17, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=c9e943c6-ac63-43f5-8ebb-c758200b9c17,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:21.134665 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.144362 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57704) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:21.145479 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5081a14b-7dc7-4d7a-be89-afab7e7415c5 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5ecd670a034341999dda6ae2d49787d1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0596938
Jun 02 16:48:21.161336 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b368679-537b-47da-af43-37df99edf6f8'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:21.163795 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c9fde0d-e816-454d-b66d-14fe2f790bad" -d '{"events": [{"server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "name": "network-vif-plugged", "status": "completed", "tag": "1b368679-537b-47da-af43-37df99edf6f8"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:21.172397 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1b368679-537b-47da-af43-37df99edf6f8,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:21.179236 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.182982 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:21.220674 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f50d53c6-66a8-44c1-a977-98b9f89a630b x-openstack-request-id: req-f50d53c6-66a8-44c1-a977-98b9f89a630b {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:21.220979 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "name": "network-vif-plugged", "status": "completed", "tag": "1b368679-537b-47da-af43-37df99edf6f8", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:21.221236 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f50d53c6-66a8-44c1-a977-98b9f89a630b {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:21.221660 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b368679-537b-47da-af43-37df99edf6f8', 'code': 200}
Jun 02 16:48:21.257781 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:21.261012 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:21.285143 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Calling delete_port for c9e943c6-ac63-43f5-8ebb-c758200b9c17 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:21.362244 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.401938 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.516857 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.519248 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b542405-5a5b-444c-89ee-a5010718a520 req-1e7eb2ed-5a49-4303-a019-18566e54da93 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:21.520740 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a4c17437-065e-45cb-8cc3-4e2977d2a10e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:21.521164 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2b542405-5a5b-444c-89ee-a5010718a520 req-1e7eb2ed-5a49-4303-a019-18566e54da93 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/ports?device_id=dcdc6155-e868-4b07-820e-2f1252a92213 HTTP/1.1" status: 200  len: 945 time: 0.1566131
Jun 02 16:48:21.532826 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.537837 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78588329-2fee-4c28-925f-fda0b6d1ea8b,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:21.545458 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['c9e943c6-ac63-43f5-8ebb-c758200b9c17'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:48:21.552481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:21.554370 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:21.602751 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2b542405-5a5b-444c-89ee-a5010718a520 req-39748265-8f13-4a57-be5f-c3b038a9c813 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.25 "GET /v2.0/security-groups?id=b27892ff-78fd-4d6d-af61-20aff85cbd99&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0660095
Jun 02 16:48:21.635952 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32925956-f142-4a94-991a-bf6c94894bd1 req-ca66811e-8fab-4ac4-bc90-cfefdd61135d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:21.637463 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32925956-f142-4a94-991a-bf6c94894bd1 req-ca66811e-8fab-4ac4-bc90-cfefdd61135d service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1098 time: 0.1762211
Jun 02 16:48:21.679558 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-32925956-f142-4a94-991a-bf6c94894bd1 req-9d9601e9-e96c-4f30-9bab-c31ff7904bb4 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0349462
Jun 02 16:48:21.685987 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Pushing event deleted for resources: {'Port': ['ID=c9e943c6-ac63-43f5-8ebb-c758200b9c17,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:21.699284 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:21.749726 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.753688 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-090fee8a-1ba7-47b9-a959-daac901eb7a5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/78588329-2fee-4c28-925f-fda0b6d1ea8b HTTP/1.1" status: 204  len: 168 time: 0.6055012
Jun 02 16:48:21.753688 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] No DVR routers for this DVR port c9e943c6-ac63-43f5-8ebb-c758200b9c17 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:21.760886 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:21.767860 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-2e593700-8a74-4a34-bd38-eee3f0d60528 req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] 10.222.0.20 "DELETE /v2.0/ports/c9e943c6-ac63-43f5-8ebb-c758200b9c17 HTTP/1.1" status: 204  len: 173 time: 0.9550562
Jun 02 16:48:21.767860 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'name': 'network-vif-deleted', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:21.767860 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c52ecb6-9f07-412e-8fb5-697168f1006c" -d '{"events": [{"server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "name": "network-vif-deleted", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:21.813776 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884dd05-40ea-44c2-b935-d23e1ca929cf req-fc42d308-b98b-4bc3-a939-30f5b6a18003 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:21.826499 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f884dd05-40ea-44c2-b935-d23e1ca929cf req-fc42d308-b98b-4bc3-a939-30f5b6a18003 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.2122910
Jun 02 16:48:21.830689 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff85eba1-686c-46d4-859a-569ea3cd491c x-openstack-request-id: req-ff85eba1-686c-46d4-859a-569ea3cd491c {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:21.831391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcdc6155-e868-4b07-820e-2f1252a92213", "name": "network-vif-deleted", "tag": "c9e943c6-ac63-43f5-8ebb-c758200b9c17", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:21.831875 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ff85eba1-686c-46d4-859a-569ea3cd491c {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:21.832590 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcdc6155-e868-4b07-820e-2f1252a92213', 'name': 'network-vif-deleted', 'tag': 'c9e943c6-ac63-43f5-8ebb-c758200b9c17', 'status': 'completed', 'code': 200}
Jun 02 16:48:21.915101 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f884dd05-40ea-44c2-b935-d23e1ca929cf req-a485a5fa-ce54-4169-8a0f-54b72eb8ef57 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0808821
Jun 02 16:48:23.109935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a503c9-d739-4ef0-931f-8911a52181ab req-a1e6bb3d-86c5-48ea-bb7d-d230403e53db tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:23.111507 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-13a503c9-d739-4ef0-931f-8911a52181ab req-a1e6bb3d-86c5-48ea-bb7d-d230403e53db tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.0832281
Jun 02 16:48:23.173308 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-13a503c9-d739-4ef0-931f-8911a52181ab req-72c211a9-dbb1-4ed9-92da-f194a8251e4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0521684
Jun 02 16:48:23.409300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4290c780-c97b-478d-92a1-de4d5de2b440 req-93cac644-f253-47f7-a54d-e2558ab11627 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:23.410896 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4290c780-c97b-478d-92a1-de4d5de2b440 req-93cac644-f253-47f7-a54d-e2558ab11627 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.0949714
Jun 02 16:48:23.469411 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-4290c780-c97b-478d-92a1-de4d5de2b440 req-d802e470-03b6-4bf0-aef4-3f4e76fc91f0 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0506656
Jun 02 16:48:23.487251 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57806) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:23.642360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57812) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:23.827287 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d5c8ec4-e605-4a25-a3f2-b402e64d8806 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:23.828785 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9d5c8ec4-e605-4a25-a3f2-b402e64d8806 tempest-TestVolumeBootPattern-1914930936 tempest-TestVolumeBootPattern-1914930936-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1093 time: 0.3402550
Jun 02 16:48:23.831749 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57820) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:23.839771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.v2.base [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Request body: {'floatingip': {'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'port_id': '1b368679-537b-47da-af43-37df99edf6f8', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address': '172.20.0.5'}} {{(pid=98278) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:48:23.847984 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:23.856572 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Usage tracker for resource:floatingip and tenant:2be2419a57e644b38a5c0ca942660a19 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:23.861407 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:24.044424 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:24.066755 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:24.391725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:24.596037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_common [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Allocated IP 172.27.0.46 (111563ce-426b-47b0-ac88-407bffa30df5/7e7273ca-7a6e-4dbc-a88a-c692752bdd51/b34cb254-e79a-41d1-9b08-4d709b160c60) {{(pid=98278) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:48:24.632747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:24.906237 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device c9e943c6-ac63-43f5-8ebb-c758200b9c17 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:24.916161 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:24.940646 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: c9e943c6-ac63-43f5-8ebb-c758200b9c17 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:24.940904 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device c9e943c6-ac63-43f5-8ebb-c758200b9c17 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:25.054432 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:25.060103 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-9a8f99f1-f10b-430c-a732-7569be0a8853 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:25.152746 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Network 111563ce-426b-47b0-ac88-407bffa30df5 is already hosted by enough agents. {{(pid=98278) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:48:25.165679 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.base_scheduler [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Resources bound (agent type, host, resource id):  {{(pid=98278) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:48:25.171325 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Received port after_create {{(pid=98278) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:48:25.222902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=b34cb254-e79a-41d1-9b08-4d709b160c60,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:25.234747 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:25.409389 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Deleting port 99e53edd-801f-43ae-b33e-b76333967555 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:25.410046 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:25.804381 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-53da7d42-d0b0-4848-bb6b-3bc56df692a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:25.822121 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] For port 99e53edd-801f-43ae-b33e-b76333967555, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=99e53edd-801f-43ae-b33e-b76333967555,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:25.822580 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:25.960071 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Calling delete_port for 99e53edd-801f-43ae-b33e-b76333967555 owned by network:router_interface {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:26.060996 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.193625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.261567 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.267395 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2d6494a7-0b1a-487f-82c5-27c0023549e0 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:26.316671 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Pushing event deleted for resources: {'Port': ['ID=99e53edd-801f-43ae-b33e-b76333967555,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:26.336360 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:26.711016 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for port, precommit_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.725094 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1737996'] for port, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.732942 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:26.793021 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:26.857382 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event updated for resources: {'Port': ['ID=b34cb254-e79a-41d1-9b08-4d709b160c60,revision_number=2']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:26.917280 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:26.934513 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683316'] for floatingip, after_update {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.187682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57878) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:27.324454 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.340339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:27.344589 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Usage tracker for resource:security_group_rule and tenant:2ad4297f3d604477a4055b32e5558de5 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:27.347841 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:27.357726 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:27.388609 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP b4ea3817-c88b-4954-9316-3df3441ecfb3 associated. External IP: 172.27.0.46, port: 1b368679-537b-47da-af43-37df99edf6f8.
Jun 02 16:48:27.454679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.460374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.468219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1911bf44-a441-4e43-82c7-2d8e403fb9fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:27.511016 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2ad4297f3d604477a4055b32e5558de5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3222320
Jun 02 16:48:27.511941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39adbfe1-a498-4280-bae8-c501daaf822a,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:27.515340 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57882) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:27.517364 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:27.672348 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Router e6c14c61-82c7-4abb-8187-fce6c8e16daa has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:48:27.693846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.721697 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.784726 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.789369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-31e53e3d-f6e2-44c0-9435-9d691f815680 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:27.804221 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39adbfe1-a498-4280-bae8-c501daaf822a,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:27.811376 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:27.811784 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:27.817394 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/39adbfe1-a498-4280-bae8-c501daaf822a HTTP/1.1" status: 204  len: 168 time: 0.3009746
Jun 02 16:48:28.039344 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:48:28.042271 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:48:28.062301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Sync routers for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:48:28.073376 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:28.074082 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b773e38b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.135054 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-692fc9af-d1b1-4e19-9842-80362c212aca admin admin] 10.222.0.25 "PUT /v2.0/routers/e6c14c61-82c7-4abb-8187-fce6c8e16daa/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 4.4913630
Jun 02 16:48:28.135671 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57890) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:28.202958 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57892) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:28.233151 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.251523 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:28.263422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:48:28.264956 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Usage tracker for resource:security_group_rule and tenant:d57879c4684c4b73b0ac1f6dd43aa4ef is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:28.270339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:28.279849 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:28.280541 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:48:28.291672 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:28.294203 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:28.295372 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1043a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:47:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.297917 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.373462 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-69791743-a4ad-43ee-9077-759a78565de8 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 4.5405452
Jun 02 16:48:28.374188 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:48:28.376760 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-215694b5-206c-4c8f-b7cc-d89206b4bc43" -d '{"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:48:28.416843 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.440381 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:48:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1007582a-d4b5-4799-a8a5-7cccdf5f7b57 x-openstack-request-id: req-1007582a-d4b5-4799-a8a5-7cccdf5f7b57 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:48:28.440764 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:48:28.441088 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1007582a-d4b5-4799-a8a5-7cccdf5f7b57 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:48:28.441536 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8', 'status': 'completed', 'code': 200}
Jun 02 16:48:28.503675 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:28.555349 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9cd6b09f-9111-4c8c-9e8f-17fe947cd5c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.645121 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b773e38b0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:48:26Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.649107 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Checking router: e6c14c61-82c7-4abb-8187-fce6c8e16daa for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:48:28.657753 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Routers {'e6c14c61-82c7-4abb-8187-fce6c8e16daa'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:28.658377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b773e38b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:48:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.700388 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.716135 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-e0377b20-7bc0-4810-8340-a3e38910ff91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:28.717726 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-e0377b20-7bc0-4810-8340-a3e38910ff91 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1098 time: 0.2476652
Jun 02 16:48:28.749650 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.778886 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.790980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c886140b-2b09-4508-9c35-286b38cf7613 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:28.822255 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:28.858609 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] Set router e6c14c61-82c7-4abb-8187-fce6c8e16daa gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:28.890705 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1043a0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}, {'id': 'b4ea3817-c88b-4954-9316-3df3441ecfb3', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.46', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '1b368679-537b-47da-af43-37df99edf6f8', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 637, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:0c:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:48:25Z', 'updated_at': '2021-06-02T16:48:25Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.896247 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:48:28.906943 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:28.907719 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1043a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:48:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:28.911049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=463a979c-0ee2-4d35-955b-936402ae1e12,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:28.924621 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:28.928220 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d57879c4684c4b73b0ac1f6dd43aa4ef&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7242458
Jun 02 16:48:28.930935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57898) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:28.961375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-c4b9d718-a636-47a2-8edc-9c3aaf023216 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:28.962787 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-c4b9d718-a636-47a2-8edc-9c3aaf023216 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.2158060
Jun 02 16:48:28.965053 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Deleting port d0891102-04ad-4704-91ad-cad011c5bb0c {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:28.965207 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.178079 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-d9c635ac-78a9-4601-86db-ce1ab2458dc0 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 200  len: 998 time: 0.1996102
Jun 02 16:48:29.216782 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b773e38b0>, [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:48:26Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:29.223427 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8f033ef-cacc-4101-a538-4ae8a0d8a6d2 None None] The sync data for ids ['e6c14c61-82c7-4abb-8187-fce6c8e16daa'] in dv-cinder-794021-2-iscsi is: [{'id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'name': 'tempest-TestMinimumBasicScenario-1139778888-router', 'tenant_id': '6dfc0270498549a6a449e9aa4beb945e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138'}], 'enable_snat': True}, 'gw_port_id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:48:26Z', 'revision_number': 5, 'project_id': '6dfc0270498549a6a449e9aa4beb945e', 'gw_port': {'id': 'd0891102-04ad-4704-91ad-cad011c5bb0c', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:04:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6c14c61-82c7-4abb-8187-fce6c8e16daa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 501, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:21Z', 'updated_at': '2021-06-02T16:45:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:48:29.229722 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.235335 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:29.248910 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] For port d0891102-04ad-4704-91ad-cad011c5bb0c, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d0891102-04ad-4704-91ad-cad011c5bb0c,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:29.249795 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.272880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.336826 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.344548 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ae5d9061-1bc5-4f1d-85f2-cb5f665610d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:29.358223 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=463a979c-0ee2-4d35-955b-936402ae1e12,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:29.360902 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:29.369730 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.371533 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-df28c386-c990-4c43-adf5-08841c1dbf3e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/463a979c-0ee2-4d35-955b-936402ae1e12 HTTP/1.1" status: 204  len: 168 time: 0.4376419
Jun 02 16:48:29.399067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Calling delete_port for d0891102-04ad-4704-91ad-cad011c5bb0c owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:29.410329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-2e515400-738d-4a69-a09e-9b4b8d248fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:29.411896 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-2e515400-738d-4a69-a09e-9b4b8d248fd6 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.2254782
Jun 02 16:48:29.530495 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-34a2f207-15cc-41a5-8899-dcb599906fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:29.531968 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-34a2f207-15cc-41a5-8899-dcb599906fd0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1061134
Jun 02 16:48:29.721789 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1043a0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}, {'id': 'b4ea3817-c88b-4954-9316-3df3441ecfb3', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.46', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '1b368679-537b-47da-af43-37df99edf6f8', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 637, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:0c:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:48:25Z', 'updated_at': '2021-06-02T16:48:25Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:29.727501 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9cc2ff-7da1-4e56-ba5f-8bec05c25a7e None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}, {'id': 'b4ea3817-c88b-4954-9316-3df3441ecfb3', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.46', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': '1b368679-537b-47da-af43-37df99edf6f8', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 637, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:0c:a7:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:48:25Z', 'updated_at': '2021-06-02T16:48:25Z', 'revision_number': 0, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:48:29.775481 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 99e53edd-801f-43ae-b33e-b76333967555 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:29.849364 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 99e53edd-801f-43ae-b33e-b76333967555 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:29.849774 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 99e53edd-801f-43ae-b33e-b76333967555 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:29.878051 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-a5c76b3c-f567-4783-ad9a-69aef2b53e7d service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3388956
Jun 02 16:48:29.885526 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:29.892926 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-df2f5c1a-7cf2-4ab9-b873-d55e0ad5a585 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:29.959274 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0891102-04ad-4704-91ad-cad011c5bb0c,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:29.969131 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:30.147802 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.224704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-864f5f3c-6e27-478b-85f3-1dcda87bd217 None None] New status for floating IP b4ea3817-c88b-4954-9316-3df3441ecfb3: ACTIVE {{(pid=98279) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:48:30.269229 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-215694b5-206c-4c8f-b7cc-d89206b4bc43 req-58ba5063-7e7f-40df-b722-2b883e7d67a0 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3768797
Jun 02 16:48:30.332035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.338674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.341694 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.372330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.373151 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e6c14c61-82c7-4abb-8187-fce6c8e16daa {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:48:30.399033 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.403334 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-67c9ed15-2a4a-45cb-98cc-852835e3d3a0 admin admin] 10.222.0.25 "DELETE /v2.0/routers/e6c14c61-82c7-4abb-8187-fce6c8e16daa HTTP/1.1" status: 204  len: 168 time: 2.2631085
Jun 02 16:48:30.403499 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57926) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:30.484974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Deleting subnet 49ee6390-6171-4f16-99cc-b1c7e54d783e {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:48:30.488883 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.552784 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.630613 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.900660 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.906247 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7202decc-48ed-4f32-8537-de3e6229ee29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:30.942217 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=49ee6390-6171-4f16-99cc-b1c7e54d783e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:30.944860 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:30.948294 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db375d0d-09de-4b87-b126-9aba0087498d None None] Network 51db2abb-3ad8-4a20-b616-e97be139cc03 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:30.954418 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.954789 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.955330 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.955501 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.955842 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.956199 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.956554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.956903 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.957252 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.957597 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.957970 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.958286 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:30.962126 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:30.963937 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-33e04956-a03b-47d9-9d37-519b46d50e35 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/49ee6390-6171-4f16-99cc-b1c7e54d783e HTTP/1.1" status: 204  len: 168 time: 0.5599625
Jun 02 16:48:30.966440 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57940) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:31.075605 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.152293 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Deleting port 01999a47-7ce7-4481-b3d5-195bd1e68bde {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:31.152654 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.232310 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] DHCP port deletion for 51db2abb-3ad8-4a20-b616-e97be139cc03 request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:48:31.258562 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] For port 01999a47-7ce7-4481-b3d5-195bd1e68bde, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=01999a47-7ce7-4481-b3d5-195bd1e68bde,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:31.258982 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.306750 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Deleting port 01999a47-7ce7-4481-b3d5-195bd1e68bde {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:31.307214 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.390232 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Calling delete_port for 01999a47-7ce7-4481-b3d5-195bd1e68bde owned by network:dhcp {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:31.432250 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] For port 01999a47-7ce7-4481-b3d5-195bd1e68bde, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=01999a47-7ce7-4481-b3d5-195bd1e68bde,segment=NetworkSegment(6e3737ad-312d-4822-9043-cd5248d86a63),segment_id=6e3737ad-312d-4822-9043-cd5248d86a63)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:31.433128 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.450514 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.455901 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ad95fd10-0bed-413e-ab8a-9f8506d297fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:31.502414 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=01999a47-7ce7-4481-b3d5-195bd1e68bde,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:31.504305 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] No DVR routers for this DVR port 01999a47-7ce7-4481-b3d5-195bd1e68bde on host dv-cinder-794021-2-iscsi {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:31.506187 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:31.582859 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Calling delete_port for 01999a47-7ce7-4481-b3d5-195bd1e68bde owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:31.636281 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.637974 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.642441 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-c257fa37-e64a-457c-acd7-010f441a6291 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:31.652318 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7abf4c10>,) {'filters': {'network_id': ['51db2abb-3ad8-4a20-b616-e97be139cc03']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:31.670412 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57964) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:31.671101 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7abf4c10>, '6e3737ad-312d-4822-9043-cd5248d86a63') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:31.671634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7abf4c10>, '6e3737ad-312d-4822-9043-cd5248d86a63') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:31.687301 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.692654 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Pushing event deleted for resources: {'Port': ['ID=01999a47-7ce7-4481-b3d5-195bd1e68bde,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:31.696013 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:31.698775 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5548c3e-4210-4f80-9dec-4b7f3093dcac None None] No DVR routers for this DVR port 01999a47-7ce7-4481-b3d5-195bd1e68bde on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:31.714753 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.721949 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Releasing vlan 682 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:48:31.722634 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:48:31.740371 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:48:31.819475 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.824376 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b8ea5c5a-7636-40e0-b93c-c5deef517a91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:31.839925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.848604 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.853415 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=51db2abb-3ad8-4a20-b616-e97be139cc03,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:31.861664 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 01999a47-7ce7-4481-b3d5-195bd1e68bde no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:31.866168 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:31.869521 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:31.870801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Usage tracker for resource:security_group_rule and tenant:9c5b5be5e5894cf0b62f0f0c3bd491f8 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:31.873960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:31.878025 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] 10.222.0.25 "DELETE /v2.0/networks/51db2abb-3ad8-4a20-b616-e97be139cc03 HTTP/1.1" status: 204  len: 168 time: 0.9103925
Jun 02 16:48:31.880777 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 57968) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:31.884389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:31.911411 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 01999a47-7ce7-4481-b3d5-195bd1e68bde {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:31.911933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 01999a47-7ce7-4481-b3d5-195bd1e68bde not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:31.912421 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d0891102-04ad-4704-91ad-cad011c5bb0c no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:31.942001 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:31.947831 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: d0891102-04ad-4704-91ad-cad011c5bb0c {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:31.948381 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d0891102-04ad-4704-91ad-cad011c5bb0c not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:31.995329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.000421 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.007481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:32.053442 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9c5b5be5e5894cf0b62f0f0c3bd491f8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3798559
Jun 02 16:48:32.053442 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2830ce66-4569-4ed6-bc39-bc74ec1e5637,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:32.055668 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:32.056175 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57970) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:32.127519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.164281 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.235967 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.240037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a23a1494-d3c9-4a37-84af-67fa88d5e92f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:32.252118 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2830ce66-4569-4ed6-bc39-bc74ec1e5637,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:32.255907 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:32.260522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.261733 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c93c56a0-5ba9-48cd-8d6f-00d077b85f44 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2830ce66-4569-4ed6-bc39-bc74ec1e5637 HTTP/1.1" status: 204  len: 168 time: 0.2043457
Jun 02 16:48:32.557339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57980) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:32.574671 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.589098 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:32.592984 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Usage tracker for resource:security_group_rule and tenant:74eb3e32756a424ebeb866909e966bab is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:32.595788 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:32.598234 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.601528 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:32.682015 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.688743 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.696476 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:32.736849 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d21e02b-73f1-4527-926b-4a81c7d2b4de,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:32.743848 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=74eb3e32756a424ebeb866909e966bab&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1853459
Jun 02 16:48:32.744440 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 57982) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:32.745262 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0270801e-86b5-47dc-b264-60492158f7e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:32.811325 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.839339 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.902052 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.907660 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-91dec629-7dde-4b74-9bd1-96edc2ca1349 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:32.919648 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d21e02b-73f1-4527-926b-4a81c7d2b4de,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:32.922668 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:32.924736 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:32.930173 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-fb8ec08e-c57b-4f0d-8d0d-67d5071c99dd admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8d21e02b-73f1-4527-926b-4a81c7d2b4de HTTP/1.1" status: 204  len: 168 time: 0.1796811
Jun 02 16:48:33.024987 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Deleting port 15b2b3f2-0370-4a41-82fd-8014da6c2f10 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:33.026056 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:33.151298 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] For port 15b2b3f2-0370-4a41-82fd-8014da6c2f10, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=15b2b3f2-0370-4a41-82fd-8014da6c2f10,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:33.151625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:33.274648 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Calling delete_port for 15b2b3f2-0370-4a41-82fd-8014da6c2f10 owned by network:router_interface {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:33.434665 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:33.439784 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e6e97f0e-4646-4676-bb4d-ed2fc85ed033 tempest-AttachVolumeShelveTestJSON-736692649 tempest-AttachVolumeShelveTestJSON-736692649-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:33.484474 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Pushing event deleted for resources: {'Port': ['ID=15b2b3f2-0370-4a41-82fd-8014da6c2f10,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:33.513906 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:33.888177 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:34.290156 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Router 836611e3-0c2b-4441-a32a-e8b7d470c8bc has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:48:34.473340 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:48:34.482934 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b2ea8230-e037-42d2-a4ad-463308106f0d admin admin] 10.222.0.25 "PUT /v2.0/routers/836611e3-0c2b-4441-a32a-e8b7d470c8bc/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6006837
Jun 02 16:48:34.486100 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58026) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:34.486685 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Sync routers for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:48:34.491317 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:34.496314 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:34.496943 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c23f880>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:48:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:34.687577 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:34.699908 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:34.880674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:34.963850 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Deleting port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:34.964202 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:34.993465 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c23f880>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35'}], 'enable_snat': True}, 'gw_port_id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:48:33Z', 'revision_number': 5, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port': {'id': '89b77bd3-6ac4-44af-93e1-19a72b61d5cd', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:0d:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:31Z', 'updated_at': '2021-06-02T16:45:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:34.998299 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Checking router: 836611e3-0c2b-4441-a32a-e8b7d470c8bc for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:48:35.008075 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Routers {'836611e3-0c2b-4441-a32a-e8b7d470c8bc'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:48:35.008716 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c23f880>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:48:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:35.170114 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] Set router 836611e3-0c2b-4441-a32a-e8b7d470c8bc gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:48:35.288293 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c23f880>, [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:48:34Z', 'revision_number': 6, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:35.294102 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b809aba5-e4b4-4e33-a206-30e489871704 None None] The sync data for ids ['836611e3-0c2b-4441-a32a-e8b7d470c8bc'] in dv-cinder-794021-2-iscsi is: [{'id': '836611e3-0c2b-4441-a32a-e8b7d470c8bc', 'name': 'tempest-TestMinimumBasicScenario-752295776-router', 'tenant_id': '49e660cc561d45bd879c28c5698e0dbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:30Z', 'updated_at': '2021-06-02T16:48:34Z', 'revision_number': 6, 'project_id': '49e660cc561d45bd879c28c5698e0dbb', 'gw_port_host': None}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:48:35.330278 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] For port 89b77bd3-6ac4-44af-93e1-19a72b61d5cd, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:35.330584 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.455733 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Calling delete_port for 89b77bd3-6ac4-44af-93e1-19a72b61d5cd owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:35.604477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.608282 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2c1914d1-8b30-4efd-88d0-a752bfc7bdbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:35.651881 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Pushing event deleted for resources: {'Port': ['ID=89b77bd3-6ac4-44af-93e1-19a72b61d5cd,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:35.655158 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:35.756156 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.936707 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.939080 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.964276 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.964818 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Fanout notify agent at l3_agent the message router_deleted on router 836611e3-0c2b-4441-a32a-e8b7d470c8bc {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:48:35.978023 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:35.979162 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] 10.222.0.25 "DELETE /v2.0/routers/836611e3-0c2b-4441-a32a-e8b7d470c8bc HTTP/1.1" status: 204  len: 168 time: 1.4920485
Jun 02 16:48:35.984453 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58042) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:36.050089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Deleting subnet dcde0601-cc3f-44e0-8824-27392d2c697c {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:48:36.053592 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.111067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.138385 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 15b2b3f2-0370-4a41-82fd-8014da6c2f10 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:36.178419 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 15b2b3f2-0370-4a41-82fd-8014da6c2f10 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:36.178763 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 15b2b3f2-0370-4a41-82fd-8014da6c2f10 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:36.198070 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.473209 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.477739 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-296961bd-1f30-4352-8315-e749b4134281 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:36.511722 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dcde0601-cc3f-44e0-8824-27392d2c697c,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:36.514865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:36.515873 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.523907 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f60b2f64-a24a-487f-a46c-2345b94c18ce None None] Network aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:48:36.525540 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-af599dc8-4bb7-44f5-9b7e-b89a3c01d5e0 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/dcde0601-cc3f-44e0-8824-27392d2c697c HTTP/1.1" status: 204  len: 168 time: 0.5412865
Jun 02 16:48:36.525718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58048) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:36.656330 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.736167 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Deleting port 5ea6ecf6-4c90-465c-92d6-9770304fa84d {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:36.736167 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.795375 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] DHCP port deletion for aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:48:36.846422 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] For port 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5ea6ecf6-4c90-465c-92d6-9770304fa84d,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:36.846782 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.920786 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Deleting port 5ea6ecf6-4c90-465c-92d6-9770304fa84d {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:48:36.921321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:36.978362 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Calling delete_port for 5ea6ecf6-4c90-465c-92d6-9770304fa84d owned by network:dhcp {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:37.019978 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] For port 5ea6ecf6-4c90-465c-92d6-9770304fa84d, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=5ea6ecf6-4c90-465c-92d6-9770304fa84d,segment=NetworkSegment(b95ee089-a680-4b57-bb97-869ed2123671),segment_id=b95ee089-a680-4b57-bb97-869ed2123671)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:48:37.020306 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.031843 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.037315 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5378ffe0-2467-4503-ac83-0e1b5f4f9991 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:37.081877 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Pushing event deleted for resources: {'Port': ['ID=5ea6ecf6-4c90-465c-92d6-9770304fa84d,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:37.083795 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] No DVR routers for this DVR port 5ea6ecf6-4c90-465c-92d6-9770304fa84d on host dv-cinder-794021-2-iscsi {{(pid=98278) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:37.085419 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:37.157147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Calling delete_port for 5ea6ecf6-4c90-465c-92d6-9770304fa84d owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:48:37.200989 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.204794 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.204981 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-082151fa-ad91-4f9e-9d9b-9bf84473f241 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:37.218341 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b7bea3b80>,) {'filters': {'network_id': ['aa8f1ae5-659f-4737-b2e8-7c1e8d416c10']}} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:37.234814 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7bea3b80>, 'b95ee089-a680-4b57-bb97-869ed2123671') {'for_net_delete': True} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:37.235147 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.services.segments.db [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b7bea3b80>, 'b95ee089-a680-4b57-bb97-869ed2123671') {} {{(pid=98278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:48:37.246141 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Pushing event deleted for resources: {'Port': ['ID=5ea6ecf6-4c90-465c-92d6-9770304fa84d,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:37.249765 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:37.250026 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7196888'] for segment, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.254691 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba2df6e2-df47-4fa7-bc0c-40b6b158f5af None None] No DVR routers for this DVR port 5ea6ecf6-4c90-465c-92d6-9770304fa84d on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:48:37.275133 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.282256 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Releasing vlan 694 on physical network physnet1 to pool {{(pid=98278) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:48:37.282721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1738192'] for segment, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]: Traceback (most recent call last):
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     timer()
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     cb(*args, **kw)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     return func(*args, **kwargs)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     self._notify()
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     self.callback(batched_events)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     event.method(event)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     return f(self, *a, **k)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._get(url).json()
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:48:37.296841 dv-cinder-794021-2-iscsi neutron-server[98278]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:48:37.494507 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.498851 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:37.517228 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.526957 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Pushing event deleted for resources: {'Network': ['ID=aa8f1ae5-659f-4737-b2e8-7c1e8d416c10,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:37.532246 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] 10.222.0.25 "DELETE /v2.0/networks/aa8f1ae5-659f-4737-b2e8-7c1e8d416c10 HTTP/1.1" status: 204  len: 168 time: 1.0029209
Jun 02 16:48:37.532246 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5bba4995-6eec-4956-a15d-5bcf791c4656 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:37.724514 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58058) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:37.777673 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-5f937d9d-277e-4db9-ab47-99745fca19ee admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6dfc0270498549a6a449e9aa4beb945e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0522676
Jun 02 16:48:37.777856 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58062) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:37.841479 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.849898 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5ea6ecf6-4c90-465c-92d6-9770304fa84d no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:37.879941 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.892599 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 5ea6ecf6-4c90-465c-92d6-9770304fa84d {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:37.893274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 5ea6ecf6-4c90-465c-92d6-9770304fa84d not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:37.894099 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 89b77bd3-6ac4-44af-93e1-19a72b61d5cd no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:48:37.933348 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 89b77bd3-6ac4-44af-93e1-19a72b61d5cd {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:48:37.933901 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 89b77bd3-6ac4-44af-93e1-19a72b61d5cd not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:48:37.949957 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.955566 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0aed2417-5675-4120-b003-50356f0a62eb tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:37.969547 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b27892ff-78fd-4d6d-af61-20aff85cbd99,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:37.971961 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:37.987863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:37.989118 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-869fb426-744b-437b-a42d-5572b10a419a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b27892ff-78fd-4d6d-af61-20aff85cbd99 HTTP/1.1" status: 204  len: 168 time: 0.2104688
Jun 02 16:48:38.367607 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58076) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:38.418293 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-72d5973c-6310-48aa-83f0-4145b4ea2396 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=49e660cc561d45bd879c28c5698e0dbb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0493367
Jun 02 16:48:38.420835 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58078) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:38.478777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:38.505255 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:38.565309 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:38.571435 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-63d4b895-2ecf-48c2-85a5-b9c0181bc14a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:38.595853 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cd9c1b8-ef77-4ab8-ad84-32a1316721be,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:38.598074 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:38.601746 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:38.603876 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7cd9c1b8-ef77-4ab8-ad84-32a1316721be HTTP/1.1" status: 204  len: 168 time: 0.1821492
Jun 02 16:48:45.194036 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58178) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:45.323073 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.338204 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:45.342817 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Usage tracker for resource:security_group_rule and tenant:52682370df254a4789e8f32ef497ed90 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:45.345831 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:45.351870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:45.441335 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.447378 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.454544 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b7eb4126-e2dd-4028-9fd6-03ab23d4f314 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:45.495079 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=52682370df254a4789e8f32ef497ed90&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2999346
Jun 02 16:48:45.496071 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83353e81-ca03-4e8f-a14b-b2930bd3b509,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:45.497947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58182) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:45.499179 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-00a05a53-a927-4434-9e4f-bb1bdf130cb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:45.653682 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.683741 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.744437 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.748712 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9e301ede-3f55-4720-8a39-2b800e1e20ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:45.760722 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83353e81-ca03-4e8f-a14b-b2930bd3b509,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:45.771772 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.772152 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.772516 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.772874 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.773225 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.773579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.773960 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.774310 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.774658 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.775002 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.775348 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.775687 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:48:45.778992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:45.782141 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/83353e81-ca03-4e8f-a14b-b2930bd3b509 HTTP/1.1" status: 204  len: 168 time: 0.2830777
Jun 02 16:48:45.783304 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-51483cab-9a53-44dd-86c7-902f7894f47f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:46.093880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58194) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:46.115230 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.130600 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:46.135254 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Usage tracker for resource:security_group_rule and tenant:55917abb471e4f26b98db056a6a44e67 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:46.138436 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:46.144663 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:46.236443 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.242210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.249248 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b5e4fb8c-8f50-4492-a57d-4232c755e112 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:46.287613 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b86357b7-4911-4138-92fe-c7491705268e,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:46.291845 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=55917abb471e4f26b98db056a6a44e67&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1965449
Jun 02 16:48:46.292718 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-794cb5e3-1969-40f3-ac63-959e255ee425 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:46.294569 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58196) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:46.358212 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.385925 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.443111 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.446778 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50a2d075-bd19-422b-b72c-24a21d04533e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:46.459620 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b86357b7-4911-4138-92fe-c7491705268e,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:46.463124 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:46.468465 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:46.469592 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b86357b7-4911-4138-92fe-c7491705268e HTTP/1.1" status: 204  len: 168 time: 0.1741381
Jun 02 16:48:46.605586 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:48:49.855690 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58218) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:49.992293 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.007216 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:48:50.011292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Usage tracker for resource:security_group_rule and tenant:055b2608669948d0941867763f606c72 is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:48:50.014235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:48:50.020235 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:48:50.101373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.107777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.119808 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c8cec609-3fa8-4f67-8c6e-f4d2d19dce62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:50.157872 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=055b2608669948d0941867763f606c72&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3010054
Jun 02 16:48:50.159944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62c961bd-5f3f-4a17-8be0-c26b65b47238,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:50.160790 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58224) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:48:50.164203 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-10bb3e2d-2c15-47c4-b723-f4033bb7a24d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:50.222547 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.250711 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.315067 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.319123 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e4847568-9e81-41ab-a417-345abe941540 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:48:50.330158 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62c961bd-5f3f-4a17-8be0-c26b65b47238,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:48:50.334848 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:48:50.336885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:50.338007 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7cb56aab-8c68-4854-a133-2974c653cd28 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/62c961bd-5f3f-4a17-8be0-c26b65b47238 HTTP/1.1" status: 204  len: 168 time: 0.1754642
Jun 02 16:48:55.803881 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-1f285b77-5fb8-4dbd-bb93-e8d643707050 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:58.498196 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-6c3d00f7-4e6a-4979-bc08-8afcbf9b7f6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:58.749004 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:48:59.952093 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b303ef-be5b-4e44-861b-0084a7d030c4 req-0985baf6-91a7-4a9e-b2d3-8c29e3c3fdcb tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:48:59.953427 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-05b303ef-be5b-4e44-861b-0084a7d030c4 req-0985baf6-91a7-4a9e-b2d3-8c29e3c3fdcb tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0847945
Jun 02 16:48:59.998596 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-05b303ef-be5b-4e44-861b-0084a7d030c4 req-96f50c6b-a4c1-4139-bc22-e99372d63cc9 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394647
Jun 02 16:49:00.219965 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:01.198909 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63bcd66a-9bed-4701-9034-8658f36e7d28 req-1235d499-fd4c-4eed-be07-8b146659ecb2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:01.200352 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63bcd66a-9bed-4701-9034-8658f36e7d28 req-1235d499-fd4c-4eed-be07-8b146659ecb2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0881314
Jun 02 16:49:01.246184 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-63bcd66a-9bed-4701-9034-8658f36e7d28 req-2c0ceb98-b8ac-4a15-942d-f52d365c1a7e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379746
Jun 02 16:49:01.870475 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:02.439152 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f09d4d4-4f4d-47b0-ae7d-ef0e0b3bd51c req-3aa2eba3-8b48-47f7-a386-65087bb95312 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:02.440579 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f09d4d4-4f4d-47b0-ae7d-ef0e0b3bd51c req-3aa2eba3-8b48-47f7-a386-65087bb95312 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0855367
Jun 02 16:49:02.498282 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4f09d4d4-4f4d-47b0-ae7d-ef0e0b3bd51c req-fa210d10-569b-4e38-9d0d-930a4dcca37b tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516322
Jun 02 16:49:03.691431 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ebe6c7-bab2-45a8-ae4f-04497958770d req-135c73e7-7609-47ac-bb5b-aacc4a08cec2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:03.692892 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-78ebe6c7-bab2-45a8-ae4f-04497958770d req-135c73e7-7609-47ac-bb5b-aacc4a08cec2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0873563
Jun 02 16:49:03.740095 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-78ebe6c7-bab2-45a8-ae4f-04497958770d req-0d0268d6-f319-4351-9cf1-bb61f0f55a3a tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408511
Jun 02 16:49:04.500559 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:04.942589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1f03922-c81a-4744-828b-3d5f3ef70829 req-8123aaf1-d435-41cc-94b3-d2c6bb870c3a tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:04.944029 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a1f03922-c81a-4744-828b-3d5f3ef70829 req-8123aaf1-d435-41cc-94b3-d2c6bb870c3a tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0901756
Jun 02 16:49:04.988591 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-a1f03922-c81a-4744-828b-3d5f3ef70829 req-e7519c0f-166e-48ff-ac0f-a1141d56ab00 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388658
Jun 02 16:49:06.004084 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-49bd5917-1436-4b36-bded-5db0b7f3558f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:06.005432 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-49bd5917-1436-4b36-bded-5db0b7f3558f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0810826
Jun 02 16:49:06.210666 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-02ae9158-75fb-4781-b540-0dc5b9927177 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:06.212119 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-02ae9158-75fb-4781-b540-0dc5b9927177 service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1809895
Jun 02 16:49:06.313498 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f20e60-eba0-4ff1-acc1-479999a7c9f6 req-4a81ddf9-d75c-4600-8382-a0d9c35f334c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:06.315013 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23f20e60-eba0-4ff1-acc1-479999a7c9f6 req-4a81ddf9-d75c-4600-8382-a0d9c35f334c tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.1944814
Jun 02 16:49:06.344522 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-fed197ac-56c0-4559-9590-0e91586cdeaf service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 1001 time: 0.1242430
Jun 02 16:49:06.402772 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-23f20e60-eba0-4ff1-acc1-479999a7c9f6 req-0b94e6e7-0bf5-4e0f-a1fd-a7b1748a1323 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0816498
Jun 02 16:49:06.420914 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-1b578e26-9d30-48ce-8062-59d67cfd2425 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:06.422379 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-1b578e26-9d30-48ce-8062-59d67cfd2425 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0673547
Jun 02 16:49:06.512371 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-754721e4-2d31-4a20-8edb-e663c88a4989 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:06.513876 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-754721e4-2d31-4a20-8edb-e663c88a4989 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0841463
Jun 02 16:49:06.648011 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-ecc076a5-06a8-4d3d-8054-5be4cec0b554 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1268430
Jun 02 16:49:06.780909 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-6432bc10-43a1-4f5e-9ffc-d61555d294f0 req-ea2d9425-0081-455b-b240-5c32303fe5c8 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1243339
Jun 02 16:49:07.609186 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4347eea3-495b-4887-8100-72516211016d req-d97c6390-4154-4336-8742-86dfe0a0f0aa tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:07.610656 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4347eea3-495b-4887-8100-72516211016d req-d97c6390-4154-4336-8742-86dfe0a0f0aa tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0927570
Jun 02 16:49:07.656593 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-4347eea3-495b-4887-8100-72516211016d req-ec4c9328-5526-4b9c-9772-a25d84c75020 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401165
Jun 02 16:49:08.880550 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafb3fba-eb73-45a8-bfe8-c17d57f996fd req-66558bcf-3981-41b6-8ae3-a4a8f0212351 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:08.882105 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cafb3fba-eb73-45a8-bfe8-c17d57f996fd req-66558bcf-3981-41b6-8ae3-a4a8f0212351 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0827301
Jun 02 16:49:08.928188 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cafb3fba-eb73-45a8-bfe8-c17d57f996fd req-0871992d-669b-4f76-b41b-3c184ecff664 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399039
Jun 02 16:49:10.119296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb434cd8-3681-4b4b-9e90-ae5303648f8d req-daa85c7b-59fd-4661-8931-ac8758664a0d tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:10.120819 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb434cd8-3681-4b4b-9e90-ae5303648f8d req-daa85c7b-59fd-4661-8931-ac8758664a0d tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0834205
Jun 02 16:49:10.170208 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-fb434cd8-3681-4b4b-9e90-ae5303648f8d req-d2b9b71d-cbdc-4bbb-bd68-9160361f3e69 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435936
Jun 02 16:49:11.376470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0d968c-d4eb-43ae-813c-a1f5fcf90adb req-74b1e701-6b31-4fe3-a79c-1794acd989cf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:11.380209 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bb0d968c-d4eb-43ae-813c-a1f5fcf90adb req-74b1e701-6b31-4fe3-a79c-1794acd989cf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0944176
Jun 02 16:49:11.423299 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-bb0d968c-d4eb-43ae-813c-a1f5fcf90adb req-a96d87dc-b2a4-4080-ab7d-455fe51751dd tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394738
Jun 02 16:49:12.644825 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d4d276-621c-492e-b64d-d37b2efd492d req-4a006692-f5c4-47b0-85cf-120a29b7bc58 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:12.646243 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-36d4d276-621c-492e-b64d-d37b2efd492d req-4a006692-f5c4-47b0-85cf-120a29b7bc58 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.1041234
Jun 02 16:49:12.692922 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-36d4d276-621c-492e-b64d-d37b2efd492d req-1b5bdcb6-ff3f-4b51-a7db-34f67ed7cab7 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408654
Jun 02 16:49:12.756413 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-26a7900f-c5f2-4fbb-b77f-c11f68a6b0af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:12.757906 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-26a7900f-c5f2-4fbb-b77f-c11f68a6b0af service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0707309
Jun 02 16:49:12.890055 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-dc50d808-044a-4387-a9cc-bfa45acf3623 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:12.891535 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-dc50d808-044a-4387-a9cc-bfa45acf3623 service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1262012
Jun 02 16:49:13.102281 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-9b0e6e28-ca1f-4612-94a8-eb9fad35d13f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 1001 time: 0.2030258
Jun 02 16:49:13.168409 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-fe07ee0f-f5cb-49b0-96c5-d967db9e9b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:13.169877 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-fe07ee0f-f5cb-49b0-96c5-d967db9e9b52 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0596890
Jun 02 16:49:13.245292 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-96bfd9a8-ef52-4860-a418-cf6a2dfc8bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:13.246704 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-96bfd9a8-ef52-4860-a418-cf6a2dfc8bf6 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0698297
Jun 02 16:49:13.388803 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-9307892b-54d5-4eb9-b327-9af139e791d0 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1329303
Jun 02 16:49:13.537686 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a24a5caa-d80a-4e06-8b2d-3e098bf2967b req-3a54b9fc-8559-4ada-a762-9a525e29454c service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1418355
Jun 02 16:49:13.897745 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99701993-3ee9-489b-bdd1-6c262ece4c4a req-5d316912-4845-468f-9741-200b5b531bc5 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:13.899289 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99701993-3ee9-489b-bdd1-6c262ece4c4a req-5d316912-4845-468f-9741-200b5b531bc5 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0964482
Jun 02 16:49:13.949115 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-99701993-3ee9-489b-bdd1-6c262ece4c4a req-1ddd981a-10f5-4155-9aec-92464652b0a1 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428133
Jun 02 16:49:15.296711 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b87885b-a356-42a0-8a88-c858581794c8 req-a8ecd75f-8ec0-466b-918c-3e117ded1393 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:15.299057 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2b87885b-a356-42a0-8a88-c858581794c8 req-a8ecd75f-8ec0-466b-918c-3e117ded1393 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0847082
Jun 02 16:49:15.354633 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2b87885b-a356-42a0-8a88-c858581794c8 req-b4815b08-c8c1-4f59-b7b8-8a3853dfc0d2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0498948
Jun 02 16:49:16.699012 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b20981-151b-4524-b9be-1ce6084e0ef0 req-187dd9dc-b976-4a44-a243-9988078952a0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:16.700729 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-34b20981-151b-4524-b9be-1ce6084e0ef0 req-187dd9dc-b976-4a44-a243-9988078952a0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0870464
Jun 02 16:49:16.750783 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-34b20981-151b-4524-b9be-1ce6084e0ef0 req-280ff336-bdc5-47d1-956c-7548c03ee253 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416312
Jun 02 16:49:17.093146 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58458) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:49:17.120626 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5291d289-a8a7-4c63-9b9d-721b9be45f0f req-87e6fddd-cb72-4d53-bde4-c4074b7a47c0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:17.122112 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5291d289-a8a7-4c63-9b9d-721b9be45f0f req-87e6fddd-cb72-4d53-bde4-c4074b7a47c0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0876703
Jun 02 16:49:17.166380 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-5291d289-a8a7-4c63-9b9d-721b9be45f0f req-cb49f148-5d78-4536-97d9-8c9a3ed333eb tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385540
Jun 02 16:49:17.214485 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-cd1608a9-a4af-4a05-87b9-b08fa0476e6d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1196733
Jun 02 16:49:18.381825 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf54992-e866-4a82-b630-39bfa24bd862 req-82672b06-d86a-42c9-90d9-7a7cbd804746 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:18.383342 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ecf54992-e866-4a82-b630-39bfa24bd862 req-82672b06-d86a-42c9-90d9-7a7cbd804746 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.1003370
Jun 02 16:49:18.430529 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-ecf54992-e866-4a82-b630-39bfa24bd862 req-29460f76-4f7a-41a3-85a2-69590fa49e60 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412126
Jun 02 16:49:19.012917 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2806bd3-7953-4452-874b-590b09784203 req-2fe6bd7e-4260-4a5d-9075-502534811e77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.014467 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-2fe6bd7e-4260-4a5d-9075-502534811e77 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a&tenant_id=b110174a94dd4df89cc6dc7b34bb7170 HTTP/1.1" status: 200  len: 1098 time: 0.0790799
Jun 02 16:49:19.112359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2806bd3-7953-4452-874b-590b09784203 req-1dd87ddc-3187-49c5-84eb-79c0f9dc99ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.113863 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-1dd87ddc-3187-49c5-84eb-79c0f9dc99ab service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0764706
Jun 02 16:49:19.219597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:49:19.248928 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2806bd3-7953-4452-874b-590b09784203 req-2ab1572d-5fb3-4371-a5e4-1774251c138e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.250407 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-2ab1572d-5fb3-4371-a5e4-1774251c138e service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1300426
Jun 02 16:49:19.340263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:19.359413 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-ac21fec4-e288-4e10-812d-72ef7a177a35 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 1001 time: 0.1017964
Jun 02 16:49:19.370528 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:19.372758 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c3ecc1d-d75c-4be9-8514-a9b0118df25b" -d '{"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-unplugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:19.381584 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:19.386597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:19.388704 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:19.427992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2806bd3-7953-4452-874b-590b09784203 req-25ecec34-2d77-459d-9834-df290505fe12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.429987 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-25ecec34-2d77-459d-9834-df290505fe12 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0633175
Jun 02 16:49:19.439342 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-beac12af-70cd-492d-a25d-cf8dcbf9a887 x-openstack-request-id: req-beac12af-70cd-492d-a25d-cf8dcbf9a887 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:19.439588 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-unplugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:19.439875 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-beac12af-70cd-492d-a25d-cf8dcbf9a887 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:19.440257 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'code': 200}
Jun 02 16:49:19.457129 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=6']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:19.464572 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.464905 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.465228 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.465552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.465924 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.466224 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.466533 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.466886 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.467211 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.467536 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.467844 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.468146 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:19.472338 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:19.517363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2806bd3-7953-4452-874b-590b09784203 req-7db86bdd-7ed6-4ce4-aa68-16ccf3a18dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.518987 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-7db86bdd-7ed6-4ce4-aa68-16ccf3a18dd6 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0760167
Jun 02 16:49:19.618621 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259c3f15-15f8-4f53-8961-924bc88ac8f5 req-81d1e4bf-84d4-4b98-a374-3ae6eb2c3dad tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:19.619994 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-259c3f15-15f8-4f53-8961-924bc88ac8f5 req-81d1e4bf-84d4-4b98-a374-3ae6eb2c3dad tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0818880
Jun 02 16:49:19.654811 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-51948382-5269-4145-9b2b-5cb706d705aa service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1280477
Jun 02 16:49:19.667532 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-259c3f15-15f8-4f53-8961-924bc88ac8f5 req-bfd3d7f4-bdf5-49cb-a246-df72550f8985 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416150
Jun 02 16:49:19.903834 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e2806bd3-7953-4452-874b-590b09784203 req-0384d82f-5945-4a62-b0f3-a97ee9a883aa service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2400496
Jun 02 16:49:20.874755 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa75400-750a-4c84-a4b5-a7110c3bec61 req-017d863d-b518-451b-a940-d2a36e1f1951 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:20.876233 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0fa75400-750a-4c84-a4b5-a7110c3bec61 req-017d863d-b518-451b-a940-d2a36e1f1951 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0876014
Jun 02 16:49:20.926895 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0fa75400-750a-4c84-a4b5-a7110c3bec61 req-d5dcba2b-6793-4940-9f40-6349ced97cec tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444531
Jun 02 16:49:22.128331 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193cdefd-d923-4b5c-8498-727155f6b7e5 req-011c6b56-2b61-4670-9802-3ad452e3c870 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:22.129835 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-193cdefd-d923-4b5c-8498-727155f6b7e5 req-011c6b56-2b61-4670-9802-3ad452e3c870 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0877283
Jun 02 16:49:22.175875 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-193cdefd-d923-4b5c-8498-727155f6b7e5 req-60e15ab7-78f8-4d2a-8b0f-16bc10bd73c5 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402761
Jun 02 16:49:23.385432 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02921b42-9ba7-45aa-b2cb-0f1b6d018951 req-f4ffec9d-a8ad-4c42-9869-11abc55b78f0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:23.386930 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-02921b42-9ba7-45aa-b2cb-0f1b6d018951 req-f4ffec9d-a8ad-4c42-9869-11abc55b78f0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.1027815
Jun 02 16:49:23.439848 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-02921b42-9ba7-45aa-b2cb-0f1b6d018951 req-5edbe8d4-bf85-46cb-9665-ec83d59b09db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448020
Jun 02 16:49:23.604919 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:49:24.631711 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-890161b2-1b60-48b4-8f7e-68eae76153d8 req-038aa934-cc6a-435c-a2d9-1ef3c8892d47 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:24.633149 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-890161b2-1b60-48b4-8f7e-68eae76153d8 req-038aa934-cc6a-435c-a2d9-1ef3c8892d47 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0834973
Jun 02 16:49:24.678031 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-890161b2-1b60-48b4-8f7e-68eae76153d8 req-2bd62409-a59a-4927-9e96-9fe033250082 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389488
Jun 02 16:49:25.797084 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-cf7d11e9-8265-4fdb-b8dc-b7fdd8332afb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:25.883270 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b22e33-c1d7-4057-8537-799aea91ed56 req-28cd4161-6b5e-43de-82da-174bdac14489 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:25.884706 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-84b22e33-c1d7-4057-8537-799aea91ed56 req-28cd4161-6b5e-43de-82da-174bdac14489 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0823221
Jun 02 16:49:25.932140 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-84b22e33-c1d7-4057-8537-799aea91ed56 req-47fd3a83-c43b-46fd-aa08-57b7e124be31 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389240
Jun 02 16:49:26.328637 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ad4444-5dec-4d78-8bb6-05e1506f3ac7 req-d63c7e67-b7e2-46a0-9a84-c4e0d6e3353e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:26.330201 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-57ad4444-5dec-4d78-8bb6-05e1506f3ac7 req-d63c7e67-b7e2-46a0-9a84-c4e0d6e3353e service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1096 time: 0.0798755
Jun 02 16:49:26.372507 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-57ad4444-5dec-4d78-8bb6-05e1506f3ac7 req-5d50d83f-1f9c-4fd7-b234-e9d93a0a2723 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0354676
Jun 02 16:49:27.137189 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bbe6ce1-36b7-409c-84fa-32534ab92236 req-64dd0d16-f8b0-4d9c-8488-36a493a5aa11 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:27.138758 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2bbe6ce1-36b7-409c-84fa-32534ab92236 req-64dd0d16-f8b0-4d9c-8488-36a493a5aa11 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 943 time: 0.0962040
Jun 02 16:49:27.186205 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-2bbe6ce1-36b7-409c-84fa-32534ab92236 req-74e82959-7753-4763-8301-e91d52b85005 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397558
Jun 02 16:49:27.272723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:49:27.424837 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:27.439994 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'port_id': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'mac_address': 'fa:16:3e:7a:72:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 665, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:49:27.503708 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:27.523117 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:49:27.541382 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:27.546686 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:27.549998 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:27.631600 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=7']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:27.635443 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:27.783030 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['4a1c5267-6d2d-4f20-832f-b6d07dd9c926'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:49:28.379481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5812d0-ccc9-406c-a5e9-11bc4b33d2d5 req-1719affa-2046-422d-b7f5-aac39badb79f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:28.380938 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f5812d0-ccc9-406c-a5e9-11bc4b33d2d5 req-1719affa-2046-422d-b7f5-aac39badb79f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 944 time: 0.0801423
Jun 02 16:49:28.435694 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-8f5812d0-ccc9-406c-a5e9-11bc4b33d2d5 req-def709f5-d4a5-4739-8cc6-0c5ddcd1d61d tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0474484
Jun 02 16:49:28.490758 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-31929994-d8b1-4521-b95b-5bb79d97ccf5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:28.748928 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:29.278933 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:49:29.381547 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:49:29.381923 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:29.499381 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:29.528450 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:29.530649 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01b5163b-4b7d-4012-95cc-7a3291565bc9" -d '{"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-plugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:29.540268 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:29.545960 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:29.548681 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-0abf7773-2af0-47b4-b8c3-3110efe353bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:29.602568 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c231d55d-7b78-4410-8d90-7727d783cb42 x-openstack-request-id: req-c231d55d-7b78-4410-8d90-7727d783cb42 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:29.602877 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-plugged", "status": "completed", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:29.603132 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c231d55d-7b78-4410-8d90-7727d783cb42 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:29.603519 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'code': 200}
Jun 02 16:49:29.625866 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=8']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:29.629216 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:30.223114 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:31.870950 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:33.494210 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58564) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:49:33.621342 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:33.635681 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:49:33.639698 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Usage tracker for resource:security_group_rule and tenant:c7af2f1d2ba34756b1c5b941b4102695 is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:49:33.642510 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:49:33.648678 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:49:33.737038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:33.742915 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:33.749783 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-f7220284-d4c1-44c7-8dc5-0020d1f3eab3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:33.874892 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0df63296-09c4-447d-9da1-ba35eef707aa,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:33.878891 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c7af2f1d2ba34756b1c5b941b4102695&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3837209
Jun 02 16:49:33.881965 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58568) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:49:33.884870 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.885235 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.885618 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.885981 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.886324 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.886686 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.887027 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.887370 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.887715 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.888057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.888398 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.888734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:33.892732 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:33.942953 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:33.969776 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:34.024024 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:34.029829 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c8df100c-014e-44b9-b6e5-3ee08a971cd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:34.043184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0df63296-09c4-447d-9da1-ba35eef707aa,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:34.046001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:34.053634 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:34.054777 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0df63296-09c4-447d-9da1-ba35eef707aa HTTP/1.1" status: 204  len: 168 time: 0.1717951
Jun 02 16:49:34.513273 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:36.613657 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-1fd375ce-0a7f-43ba-8915-b80c20570bf8 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=fd1161d1b5634d58af560104bafb863d&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0282693
Jun 02 16:49:36.777933 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-8347fd31-90a3-4921-963e-f6ff7a26bc45 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:36.779417 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-8347fd31-90a3-4921-963e-f6ff7a26bc45 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1604755
Jun 02 16:49:36.795027 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-7b418aa2-6eb6-443a-a0d6-2073f4e57a1f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/quotas/fd1161d1b5634d58af560104bafb863d HTTP/1.1" status: 200  len: 375 time: 0.0097525
Jun 02 16:49:36.856004 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-c24116fd-2572-44db-a66e-f250d8dbeab1 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=fd1161d1b5634d58af560104bafb863d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0551577
Jun 02 16:49:37.038102 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-5d60632c-34b4-4723-a660-7a13924e99b5 req-f480df0b-016b-401d-93e5-908ff3450497 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0457180
Jun 02 16:49:38.133558 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-02c4796c-ec81-4df3-85d4-8644af525711 req-a2415d76-9dee-48b9-b6ec-1108e29f1589 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0433419
Jun 02 16:49:39.232623 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1338b362-4dc8-4361-b59c-776372b3ee77 req-acdf18e1-03a6-4dbd-a5a9-24da9269515f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0461304
Jun 02 16:49:40.326605 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f4fdd829-905e-4005-9636-6c7b2b33b0c7 req-17c9472e-fc36-4c70-a9dc-5dd0341bc255 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0418615
Jun 02 16:49:41.496049 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-9d2dcad0-972a-4be6-90b0-d55729febfd1 req-e6af1517-27f8-4ffb-92f1-48fa8d78b696 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0525284
Jun 02 16:49:42.127903 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-d176f62e-3037-408e-8347-f01f4734e7e8 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.20 "GET /v2.0/networks?tenant_id=fd1161d1b5634d58af560104bafb863d&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0382204
Jun 02 16:49:42.283509 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-b212b934-ecdf-4159-a2d7-8af78b2ca1fc tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:42.284958 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-b212b934-ecdf-4159-a2d7-8af78b2ca1fc tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1523728
Jun 02 16:49:42.305248 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Request body: {'port': {'device_id': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c', 'admin_state_up': True, 'tenant_id': 'fd1161d1b5634d58af560104bafb863d'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:49:42.444829 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:49:42.449441 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Usage tracker for resource:port and tenant:fd1161d1b5634d58af560104bafb863d is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:49:42.451701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:49:42.457402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:49:42.470275 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Made reservation on behalf of fd1161d1b5634d58af560104bafb863d for: {'port': 1} {{(pid=98277) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 02 16:49:42.473865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:42.486813 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks [] for security_group, before_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:42.502061 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:49:42.506107 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Usage tracker for resource:security_group_rule and tenant:fd1161d1b5634d58af560104bafb863d is out of sync, need to count used quota {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:49:42.508947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98277) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:49:42.514706 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.quota.driver [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98277) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:49:42.601191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks [] for security_group, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:42.607974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:42.610963 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-03af34ac-25f9-42eb-9864-53f758846d85 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:42.701986 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ce3a843-ddc3-42f3-829d-01d5a7b40735,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:42.707656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:42.796170 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_common [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Allocated IP 192.168.233.107 (df15a956-c901-4c9d-90c9-65fb2e952f5c/7571ff92-bbfe-47fd-9d8a-fead904d9807/906acbc7-45a9-4cfc-a810-e2564aafb0ee) {{(pid=98277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 02 16:49:42.842966 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-518d21b8-dde1-46fc-9357-184258427353 req-53ee7ee7-0d75-4ab9-9674-977f77ad694f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.2399225
Jun 02 16:49:43.154721 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks [] for port, precommit_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.171866 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Transition to ACTIVE for port object 906acbc7-45a9-4cfc-a810-e2564aafb0ee will not be triggered until provisioned by entity DHCP. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:49:43.196571 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769112229358', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_create {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.202486 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-f74e5160-d051-4013-b0b1-cd1b30c6067b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:43.268277 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Network df15a956-c901-4c9d-90c9-65fb2e952f5c is already hosted by enough agents. {{(pid=98277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 02 16:49:43.269393 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.base_scheduler [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Resources bound (agent type, host, resource id):  {{(pid=98277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 02 16:49:43.273419 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Received port after_create {{(pid=98277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 02 16:49:43.313389 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Pushing event updated for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=1']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:43.319326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:43.350369 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:43.351048 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.386920 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-3ad01818-62f7-460c-a21b-47c8a4ffd338 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 1.0850642
Jun 02 16:49:43.398531 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.v2.base [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Request body: {'port': {'device_id': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79402'}} {{(pid=98277) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 02 16:49:43.507689 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.532974 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9b2c6ae8-f5ae-4519-a422-7f382c5633db None None] Provisioning for port 906acbc7-45a9-4cfc-a810-e2564aafb0ee completed by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:49:43.538743 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-9b2c6ae8-f5ae-4519-a422-7f382c5633db None None] Provisioning complete for port 906acbc7-45a9-4cfc-a810-e2564aafb0ee triggered by entity DHCP. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:49:43.539059 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9b2c6ae8-f5ae-4519-a422-7f382c5633db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.593344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-9b2c6ae8-f5ae-4519-a422-7f382c5633db None None] Port 906acbc7-45a9-4cfc-a810-e2564aafb0ee cannot update to ACTIVE because it is not bound. {{(pid=98279) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 02 16:49:43.864363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 906acbc7-45a9-4cfc-a810-e2564aafb0ee {{(pid=98277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:49:43.872463 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks [] for port, precommit_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.887387 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.provisioning_blocks [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Transition to ACTIVE for port object 906acbc7-45a9-4cfc-a810-e2564aafb0ee will not be triggered until provisioned by entity L2. {{(pid=98277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 02 16:49:43.891748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:43.895546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-bef73458-5e77-46a5-baf5-e461f5cdaa2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:44.044491 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Pushing event updated for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=2']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:44.053864 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:44.096139 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2772f2-8f8a-41c2-83a5-cde43198b466 req-567bb101-6457-45d7-aa78-62aeb5203c1a tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:44.098302 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3b2772f2-8f8a-41c2-83a5-cde43198b466 req-567bb101-6457-45d7-aa78-62aeb5203c1a tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 948 time: 0.1504366
Jun 02 16:49:44.131382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Attempting to bind port 906acbc7-45a9-4cfc-a810-e2564aafb0ee on host hv-cinder-79402 for vnic_type normal with profile  {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 02 16:49:44.131702 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Attempting to bind port 906acbc7-45a9-4cfc-a810-e2564aafb0ee by drivers openvswitch,hyperv on host hv-cinder-79402 at level 0 using segments [{'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 02 16:49:44.132019 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Attempting to bind port 906acbc7-45a9-4cfc-a810-e2564aafb0ee on network df15a956-c901-4c9d-90c9-65fb2e952f5c {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:49:44.136573 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Port 906acbc7-45a9-4cfc-a810-e2564aafb0ee on network df15a956-c901-4c9d-90c9-65fb2e952f5c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79402 {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 02 16:49:44.136878 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Attempting to bind port 906acbc7-45a9-4cfc-a810-e2564aafb0ee on network df15a956-c901-4c9d-90c9-65fb2e952f5c {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 02 16:49:44.142169 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Checking agent: {'id': '96f1a33d-490b-4496-a2cd-6a71fc7f435b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79402', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'started_at': datetime.datetime(2021, 6, 2, 16, 38, 4), 'heartbeat_timestamp': datetime.datetime(2021, 6, 2, 16, 49, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 02 16:49:44.142470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Checking segment: {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 02 16:49:44.142863 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Bound using segment: {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'} {{(pid=98277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 02 16:49:44.143276 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.managers [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Bound port: 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host: hv-cinder-79402, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '342a2186-2b87-4389-8067-dddb1c928cda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 663, 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c'}}] {{(pid=98277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 02 16:49:44.143627 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:44.144648 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-3b2772f2-8f8a-41c2-83a5-cde43198b466 req-e9f73cb6-9e41-4009-823d-2a704203c630 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398922
Jun 02 16:49:44.232672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, cleared binding levels {{(pid=98277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 02 16:49:44.235768 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 02 16:49:44.242751 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-11423265'] for port, after_update {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:44.246562 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-388d4bd6-3a69-44c2-8093-78955f5c4a10 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:44.306315 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:44.306953 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:44.312374 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-6b764839-9164-45f5-a30e-0f350659516b service neutron] 10.222.0.20 "PUT /v2.0/ports/906acbc7-45a9-4cfc-a810-e2564aafb0ee HTTP/1.1" status: 200  len: 1098 time: 0.9146831
Jun 02 16:49:44.312374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:44.312374 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa602f9a-28d9-4fce-baf5-a05a615c22e7" -d '{"events": [{"name": "network-changed", "server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:44.331534 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Pushing event updated for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=3']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:44.335770 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6b764839-9164-45f5-a30e-0f350659516b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:44.388672 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ebaba6f-521d-454a-9cc1-9279af59938c x-openstack-request-id: req-0ebaba6f-521d-454a-9cc1-9279af59938c {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:44.389005 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:44.389294 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0ebaba6f-521d-454a-9cc1-9279af59938c {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:44.389740 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee', 'status': 'completed', 'code': 200}
Jun 02 16:49:44.440725 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-76afeedf-7b18-4eb7-9293-0af7b3ffba90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:44.442284 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-76afeedf-7b18-4eb7-9293-0af7b3ffba90 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=fd1161d1b5634d58af560104bafb863d&device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 1101 time: 0.0882561
Jun 02 16:49:44.514765 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-a0c9d53b-52e4-4a14-8437-8b1cfb75de5d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee HTTP/1.1" status: 200  len: 217 time: 0.0649703
Jun 02 16:49:44.581014 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-9024894c-6871-4fbd-8d6a-95f88b2e639e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:44.582407 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-9024894c-6871-4fbd-8d6a-95f88b2e639e service neutron] 10.222.0.20 "GET /v2.0/subnets?id=7571ff92-bbfe-47fd-9d8a-fead904d9807 HTTP/1.1" status: 200  len: 843 time: 0.0600581
Jun 02 16:49:44.665631 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-cff837d9-9938-4e8b-8037-e25bfdd4ebb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:44.667164 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-cff837d9-9938-4e8b-8037-e25bfdd4ebb2 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=df15a956-c901-4c9d-90c9-65fb2e952f5c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0768449
Jun 02 16:49:44.812957 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-f33e6c09-6c7b-4de9-8190-225f7f0bc2bb service neutron] 10.222.0.20 "GET /v2.0/networks/df15a956-c901-4c9d-90c9-65fb2e952f5c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1383088
Jun 02 16:49:45.044836 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-a792069b-9c4c-4295-9de7-754f181ee8d2 req-c3cf8396-466d-491f-a796-3222ad230f9d service neutron] 10.222.0.20 "GET /v2.0/networks/df15a956-c901-4c9d-90c9-65fb2e952f5c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2252467
Jun 02 16:49:45.188152 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-6f70ddb0-ec4e-45ed-97cc-d6dccf3d223c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:45.189721 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-6f70ddb0-ec4e-45ed-97cc-d6dccf3d223c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=fd1161d1b5634d58af560104bafb863d&device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 1101 time: 0.0833397
Jun 02 16:49:45.325000 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-6f63f536-812d-4c1f-ac6d-a133e16b08ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:45.326619 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-6f63f536-812d-4c1f-ac6d-a133e16b08ad service neutron] 10.222.0.20 "GET /v2.0/networks?id=df15a956-c901-4c9d-90c9-65fb2e952f5c HTTP/1.1" status: 200  len: 870 time: 0.1300094
Jun 02 16:49:45.333116 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acb88f4-014e-4841-8c11-c91524c2b485 req-f3178659-ab8b-48d0-bf45-11dd036222a5 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:45.334633 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1acb88f4-014e-4841-8c11-c91524c2b485 req-f3178659-ab8b-48d0-bf45-11dd036222a5 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 948 time: 0.0832040
Jun 02 16:49:45.380052 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-1acb88f4-014e-4841-8c11-c91524c2b485 req-673de693-c0ba-41e4-9731-a6cecf7a99e1 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395310
Jun 02 16:49:45.403207 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-3f8efdd1-0c4c-4998-97f0-1b94ddbb0df8 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee HTTP/1.1" status: 200  len: 217 time: 0.0647693
Jun 02 16:49:45.475012 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-c93e9a2f-f317-4879-a7bf-d746232209a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:45.476437 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-c93e9a2f-f317-4879-a7bf-d746232209a9 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=7571ff92-bbfe-47fd-9d8a-fead904d9807 HTTP/1.1" status: 200  len: 843 time: 0.0698357
Jun 02 16:49:45.563914 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-17c55cab-7c69-490b-8f89-40943ea9b7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:45.565399 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-17c55cab-7c69-490b-8f89-40943ea9b7a3 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=df15a956-c901-4c9d-90c9-65fb2e952f5c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0768721
Jun 02 16:49:45.701002 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-c9abfa9f-a558-417f-bfed-ba8c225d6337 service neutron] 10.222.0.20 "GET /v2.0/networks/df15a956-c901-4c9d-90c9-65fb2e952f5c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1279528
Jun 02 16:49:45.838056 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-fa602f9a-28d9-4fce-baf5-a05a615c22e7 req-ba3e8689-064a-4d43-8337-fdcfe9c24c2f service neutron] 10.222.0.20 "GET /v2.0/networks/df15a956-c901-4c9d-90c9-65fb2e952f5c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281381
Jun 02 16:49:46.585435 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-4d5a95d1-b6e1-479a-af3e-84b5c9698ec7 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:46.586215 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-4d5a95d1-b6e1-479a-af3e-84b5c9698ec7 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Synchronizing usage tracker for tenant:fd1161d1b5634d58af560104bafb863d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:49:46.606197 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-4d5a95d1-b6e1-479a-af3e-84b5c9698ec7 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Unset dirty status for tenant:fd1161d1b5634d58af560104bafb863d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:49:46.607421 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-4d5a95d1-b6e1-479a-af3e-84b5c9698ec7 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 948 time: 0.1151528
Jun 02 16:49:46.660789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-2fe1d2e1-053a-47b7-9b4c-94514cb06822 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Synchronizing usage tracker for tenant:fd1161d1b5634d58af560104bafb863d on resource:security_group {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:49:46.680203 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-2fe1d2e1-053a-47b7-9b4c-94514cb06822 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Unset dirty status for tenant:fd1161d1b5634d58af560104bafb863d on resource:security_group {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:49:46.681728 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-32f92262-e90d-4410-9174-e9efc5ce8d09 req-2fe1d2e1-053a-47b7-9b4c-94514cb06822 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0666318
Jun 02 16:49:47.278342 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 906acbc7-45a9-4cfc-a810-e2564aafb0ee details requested by agent hyperv_hv-cinder-79402 with host hv-cinder-79402 {{(pid=98279) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 02 16:49:47.420552 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:47.435817 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Returning: {'device': '906acbc7-45a9-4cfc-a810-e2564aafb0ee', 'network_id': 'df15a956-c901-4c9d-90c9-65fb2e952f5c', 'port_id': '906acbc7-45a9-4cfc-a810-e2564aafb0ee', 'mac_address': 'fa:16:3e:94:00:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7571ff92-bbfe-47fd-9d8a-fead904d9807', 'ip_address': '192.168.233.107'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98279) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 02 16:49:47.495097 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:47.513056 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 906acbc7-45a9-4cfc-a810-e2564aafb0ee {{(pid=98279) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 02 16:49:47.530321 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:47.535776 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:47.538989 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:47.610106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=4']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:47.613590 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:47.781377 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['906acbc7-45a9-4cfc-a810-e2564aafb0ee'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:49:47.870681 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5d6ec4-6b23-4c99-bae2-666fd704318c req-b70ee172-037a-47e4-ac34-6428a6afbcb6 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:47.872145 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c5d6ec4-6b23-4c99-bae2-666fd704318c req-b70ee172-037a-47e4-ac34-6428a6afbcb6 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 949 time: 0.0817196
Jun 02 16:49:47.923493 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-6c5d6ec4-6b23-4c99-bae2-666fd704318c req-bf3bef34-b08c-464e-887b-1a63994d11e6 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454960
Jun 02 16:49:49.120213 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0fdeb4-9485-469c-abb1-c290d960473b req-fed8e64a-e1d0-4ee3-91be-30a23cad1c2f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:49.121706 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf0fdeb4-9485-469c-abb1-c290d960473b req-fed8e64a-e1d0-4ee3-91be-30a23cad1c2f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 949 time: 0.0851688
Jun 02 16:49:49.170729 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-cf0fdeb4-9485-469c-abb1-c290d960473b req-85e62213-9e73-4d6a-a505-51bc7f328e71 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429485
Jun 02 16:49:49.295106 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 906acbc7-45a9-4cfc-a810-e2564aafb0ee up at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 02 16:49:49.367247 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning for port 906acbc7-45a9-4cfc-a810-e2564aafb0ee completed by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 02 16:49:49.372962 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.provisioning_blocks [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Provisioning complete for port 906acbc7-45a9-4cfc-a810-e2564aafb0ee triggered by entity L2. {{(pid=98279) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 02 16:49:49.373340 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3611826'] for port, provisioning_complete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:49.497760 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3560707'] for port, before_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:49.525346 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee'}] {{(pid=98279) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:49.527660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e36eb2cd25004b1aa6f2aa7b41345938b2cd98f83f85b1b6b22e09b3b30b9206" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-914ce27b-cc5a-4727-8093-7e4c1e0729f3" -d '{"events": [{"server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "name": "network-vif-plugged", "status": "completed", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee"}]}' {{(pid=98279) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:49.537260 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:49.541887 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769112668106', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769112230916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769112230961'] for port, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:49.543866 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:49.573482 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b7bd7cf-b98d-4002-ae09-05a4974d5346 x-openstack-request-id: req-9b7bd7cf-b98d-4002-ae09-05a4974d5346 {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:49.573805 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "name": "network-vif-plugged", "status": "completed", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee", "code": 200}]} {{(pid=98279) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:49.574063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9b7bd7cf-b98d-4002-ae09-05a4974d5346 {{(pid=98279) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:49.574450 dv-cinder-794021-2-iscsi neutron-server[98279]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee', 'code': 200}
Jun 02 16:49:49.615865 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Pushing event updated for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=5']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:49.619044 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:49.809722 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9504ca1d-4795-4dda-99fc-9796d7c3ca55 req-4ba7c776-8f8b-4bc8-96fb-84713579e3db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:49.811931 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9504ca1d-4795-4dda-99fc-9796d7c3ca55 req-4ba7c776-8f8b-4bc8-96fb-84713579e3db service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 1103 time: 0.0752199
Jun 02 16:49:49.870850 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9504ca1d-4795-4dda-99fc-9796d7c3ca55 req-290e46dd-ab84-4f8d-8d0d-8349a007be5b service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0516322
Jun 02 16:49:50.365576 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82157036-0ecc-4033-8d44-cff0e12f4ee5 req-53c358c5-b801-4084-b1bc-06b9faf6e673 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:50.367267 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82157036-0ecc-4033-8d44-cff0e12f4ee5 req-53c358c5-b801-4084-b1bc-06b9faf6e673 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 950 time: 0.0878203
Jun 02 16:49:50.416307 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-82157036-0ecc-4033-8d44-cff0e12f4ee5 req-b3dabcbc-1c86-4522-84df-5f26c318b50c tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428045
Jun 02 16:49:51.622992 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b885381e-b98e-433c-aacb-fca8f94c09f0 req-e1d07807-b4ec-4161-ac44-dbe740c0fc61 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:51.624429 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b885381e-b98e-433c-aacb-fca8f94c09f0 req-e1d07807-b4ec-4161-ac44-dbe740c0fc61 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 950 time: 0.0915730
Jun 02 16:49:51.680208 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-b885381e-b98e-433c-aacb-fca8f94c09f0 req-dc814bb7-3a31-4e9a-81ed-cf1a0504b18d tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498099
Jun 02 16:49:52.137057 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38016bd7-5043-43ad-949a-703408e2677c req-a14756eb-3238-4e9e-943d-cdcc21b7ac9e tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:52.138619 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-38016bd7-5043-43ad-949a-703408e2677c req-a14756eb-3238-4e9e-943d-cdcc21b7ac9e tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 950 time: 0.0877869
Jun 02 16:49:52.184614 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-38016bd7-5043-43ad-949a-703408e2677c req-8e7c06a7-2e31-4578-9318-eea570c3eda8 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402868
Jun 02 16:49:53.431280 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbc72d6-38cc-4464-baa0-716fd1f37c35 req-7f4eee67-6829-45ea-bce7-ac8847d6a39f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:53.432903 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adbc72d6-38cc-4464-baa0-716fd1f37c35 req-7f4eee67-6829-45ea-bce7-ac8847d6a39f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 950 time: 0.1392593
Jun 02 16:49:53.474102 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-39a17011-83f2-414f-bf84-3176412d88e5 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:53.475709 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-39a17011-83f2-414f-bf84-3176412d88e5 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.20 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 950 time: 0.1358495
Jun 02 16:49:53.547571 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-adbc72d6-38cc-4464-baa0-716fd1f37c35 req-ffde9d8d-a00d-4269-a990-64a5298ebaf2 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/security-groups?id=4ce3a843-ddc3-42f3-829d-01d5a7b40735&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1057112
Jun 02 16:49:53.632823 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Deleting port 906acbc7-45a9-4cfc-a810-e2564aafb0ee {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:49:53.633123 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:53.767998 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] For port 906acbc7-45a9-4cfc-a810-e2564aafb0ee, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=906acbc7-45a9-4cfc-a810-e2564aafb0ee,segment=NetworkSegment(342a2186-2b87-4389-8067-dddb1c928cda),segment_id=342a2186-2b87-4389-8067-dddb1c928cda)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:49:53.767998 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:54.006472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Calling delete_port for 906acbc7-45a9-4cfc-a810-e2564aafb0ee owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:49:54.122832 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:54.128676 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-6d6d37f6-e794-4924-94a9-d2652f0c9fe3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:54.135363 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] get_ports_and_sgs() called for port_ids ['906acbc7-45a9-4cfc-a810-e2564aafb0ee'] {{(pid=98279) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 02 16:49:54.175128 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Pushing event deleted for resources: {'Port': ['ID=906acbc7-45a9-4cfc-a810-e2564aafb0ee,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:54.218773 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.219161 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.219522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.219934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.220241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.220587 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.220931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.221261 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.221665 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.222002 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.222342 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.222686 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:49:54.230570 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:54.267748 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] No DVR routers for this DVR port 906acbc7-45a9-4cfc-a810-e2564aafb0ee on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:49:54.270793 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:54.275316 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'name': 'network-vif-deleted', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:54.277796 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92677b39-c5d1-43f9-ba10-4f2a5f7e2aec" -d '{"events": [{"server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "name": "network-vif-deleted", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:54.295451 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-b9d3ee0f-a80b-4048-81bf-8af44cda59fc req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.20 "DELETE /v2.0/ports/906acbc7-45a9-4cfc-a810-e2564aafb0ee HTTP/1.1" status: 204  len: 173 time: 0.8098893
Jun 02 16:49:54.328206 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-399b5249-1ba1-4292-b72e-f5ee02e7b7d7 x-openstack-request-id: req-399b5249-1ba1-4292-b72e-f5ee02e7b7d7 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:54.328587 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4fa6fc31-9c3a-4456-8688-60822e1e8a2e", "name": "network-vif-deleted", "tag": "906acbc7-45a9-4cfc-a810-e2564aafb0ee", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:54.328888 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-399b5249-1ba1-4292-b72e-f5ee02e7b7d7 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:54.329494 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4fa6fc31-9c3a-4456-8688-60822e1e8a2e', 'name': 'network-vif-deleted', 'tag': '906acbc7-45a9-4cfc-a810-e2564aafb0ee', 'status': 'completed', 'code': 200}
Jun 02 16:49:54.716911 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-93e2064b-a7cb-4dd1-884b-cc3bf42d24e9 req-ca38397f-00ef-47af-896e-12bfc6ebbcf3 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Synchronizing usage tracker for tenant:fd1161d1b5634d58af560104bafb863d on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:49:54.735982 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-93e2064b-a7cb-4dd1-884b-cc3bf42d24e9 req-ca38397f-00ef-47af-896e-12bfc6ebbcf3 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Unset dirty status for tenant:fd1161d1b5634d58af560104bafb863d on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:49:54.737268 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-93e2064b-a7cb-4dd1-884b-cc3bf42d24e9 req-ca38397f-00ef-47af-896e-12bfc6ebbcf3 tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] 10.222.0.25 "GET /v2.0/ports?device_id=4fa6fc31-9c3a-4456-8688-60822e1e8a2e HTTP/1.1" status: 200  len: 210 time: 0.0629625
Jun 02 16:49:55.802907 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-767219c0-ccbd-4fee-8761-8f07bda38ea9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:57.324623 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 906acbc7-45a9-4cfc-a810-e2564aafb0ee no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:49:57.359247 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 906acbc7-45a9-4cfc-a810-e2564aafb0ee {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:49:57.359582 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 906acbc7-45a9-4cfc-a810-e2564aafb0ee not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:49:58.005003 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58856) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:49:58.332156 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port b34cb254-e79a-41d1-9b08-4d709b160c60 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:49:58.332477 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.456363 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.456789 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.494817 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d49f8260-5806-4d46-aa2d-73aa448a1c4d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.580218 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for b34cb254-e79a-41d1-9b08-4d709b160c60 owned by network:floatingip {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:49:58.708217 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.712195 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ec60fbd2-372c-4b3b-80c8-4e0452481070 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:49:58.745123 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.791330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=b34cb254-e79a-41d1-9b08-4d709b160c60,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:49:58.794309 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:49:58.861096 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:58.861533 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.db.l3_db [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP b4ea3817-c88b-4954-9316-3df3441ecfb3 disassociated (deleted). External IP: 172.27.0.46, port: 1b368679-537b-47da-af43-37df99edf6f8.
Jun 02 16:49:59.339091 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:49:59.529842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:49:59.542274 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:49:59.551727 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:49:59.552410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c0850>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:49:59.552751 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:49:59.613482 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "DELETE /v2.0/floatingips/b4ea3817-c88b-4954-9316-3df3441ecfb3 HTTP/1.1" status: 204  len: 168 time: 1.6068878
Jun 02 16:49:59.614123 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:49:59.616487 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1bdc779f-e2a5-4cc0-add7-7679aea554fd" -d '{"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:49:59.664483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:49:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14ba6455-40ee-4dbd-a684-4b3df2cbe34e x-openstack-request-id: req-14ba6455-40ee-4dbd-a684-4b3df2cbe34e {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:49:59.664803 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "tag": "1b368679-537b-47da-af43-37df99edf6f8", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:49:59.665095 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-14ba6455-40ee-4dbd-a684-4b3df2cbe34e {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:49:59.665547 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'tag': '1b368679-537b-47da-af43-37df99edf6f8', 'status': 'completed', 'code': 200}
Jun 02 16:49:59.737367 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:49:59.766358 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-252b6884-e241-49a8-93bf-ca579f6fc0fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:59.768921 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-252b6884-e241-49a8-93bf-ca579f6fc0fc service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 1098 time: 0.0798225
Jun 02 16:49:59.968868 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-d25ca992-307e-48c6-b1ca-f39569c77db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:49:59.970720 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-d25ca992-307e-48c6-b1ca-f39569c77db6 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1943066
Jun 02 16:50:00.029556 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d27bcf-6113-42b1-9f48-959f9728a237 req-b04b8c77-7e45-4ce8-b43b-18d86dc732e1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:00.032204 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e2d27bcf-6113-42b1-9f48-959f9728a237 req-b04b8c77-7e45-4ce8-b43b-18d86dc732e1 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.1088445
Jun 02 16:50:00.066724 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-d01a51ba-b038-4f2e-904d-04e241f281c4 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 200  len: 217 time: 0.0869358
Jun 02 16:50:00.085730 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-e2d27bcf-6113-42b1-9f48-959f9728a237 req-3ad70bb0-7b33-4349-81a6-e98966280b68 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0458987
Jun 02 16:50:00.134344 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-839e545d-e5d8-4424-9d84-2b46674601f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:00.135856 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-839e545d-e5d8-4424-9d84-2b46674601f9 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0605023
Jun 02 16:50:00.150885 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c0850>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:00.155159 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:00.164162 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:00.164859 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c0850>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:00.214191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-009f21ed-7f26-449a-aff2-6f77ec877e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:00.215744 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-009f21ed-7f26-449a-aff2-6f77ec877e23 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725045
Jun 02 16:50:00.228051 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-fd1b9444-9e61-423d-aa46-0325257495f0 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98277) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 02 16:50:00.228980 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-fd1b9444-9e61-423d-aa46-0325257495f0 service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0056808
Jun 02 16:50:00.255429 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:00.357998 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:00.364602 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-34f8ca3c-8372-457e-bf7f-2a1880d41bd1 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278570
Jun 02 16:50:00.504195 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1bdc779f-e2a5-4cc0-add7-7679aea554fd req-6deefffe-336d-4261-a598-b3087b11575b service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1320651
Jun 02 16:50:00.605406 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:50:00.716307 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 58922) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:00.721038 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c1c0850>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:00.725506 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0b874d5-4193-4bc4-aab1-1ba55b649e7c None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_floatingips': [{'id': '1fdb1653-c232-484c-ba7e-bc157fc316bb', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'floating_ip_address': '172.27.0.73', 'floating_network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'router_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'port_id': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'mac_address': 'fa:16:3e:26:27:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-02T16:46:24Z', 'updated_at': '2021-06-02T16:46:29Z', 'revision_number': 1, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:00.874607 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-0c3ec601-c46c-418f-b79c-a52c05e6a704 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=fd1161d1b5634d58af560104bafb863d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1567204
Jun 02 16:50:00.877000 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 58928) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:00.940912 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:00.941273 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf8f2049-f2b7-471a-bbfe-d89d17f56d0d None None] New status for floating IP b4ea3817-c88b-4954-9316-3df3441ecfb3: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:50:00.967748 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:01.021488 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:01.025280 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-e500a6cb-1eca-48f4-98c8-f3f8a704165c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:01.041080 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ce3a843-ddc3-42f3-829d-01d5a7b40735,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:01.043955 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:01.060964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:01.065252 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b758c8d1-004d-4e0d-803e-920c104552b0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4ce3a843-ddc3-42f3-829d-01d5a7b40735 HTTP/1.1" status: 204  len: 168 time: 0.1871126
Jun 02 16:50:01.280177 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b95df15-82e8-4fc6-8926-0c1a790a605d req-69ca6fc6-d51d-43fa-aca5-437c98e957bb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:01.281000 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-0b95df15-82e8-4fc6-8926-0c1a790a605d req-69ca6fc6-d51d-43fa-aca5-437c98e957bb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:50:01.299546 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-0b95df15-82e8-4fc6-8926-0c1a790a605d req-69ca6fc6-d51d-43fa-aca5-437c98e957bb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:50:01.300740 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0b95df15-82e8-4fc6-8926-0c1a790a605d req-69ca6fc6-d51d-43fa-aca5-437c98e957bb tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.1042047
Jun 02 16:50:01.355248 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-0b95df15-82e8-4fc6-8926-0c1a790a605d req-0f6efc62-bf6e-4865-9729-d8e2982fa6f7 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0482125
Jun 02 16:50:01.535142 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-17d02373-4de7-4cc6-8373-e6f7635fab31 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:01.536649 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-17d02373-4de7-4cc6-8373-e6f7635fab31 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 945 time: 0.0849514
Jun 02 16:50:01.673878 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port 1b368679-537b-47da-af43-37df99edf6f8 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:01.674223 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:01.809031 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] For port 1b368679-537b-47da-af43-37df99edf6f8, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=1b368679-537b-47da-af43-37df99edf6f8,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:01.809382 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:01.872470 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:02.048893 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for 1b368679-537b-47da-af43-37df99edf6f8 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:02.166913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:02.174467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-d897e57d-75f0-41a8-b328-01d2c3607aca tempest-DeleteServersTestJSON-1545278531 tempest-DeleteServersTestJSON-1545278531-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:02.250229 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=1b368679-537b-47da-af43-37df99edf6f8,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:02.258128 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:02.299492 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] No DVR routers for this DVR port 1b368679-537b-47da-af43-37df99edf6f8 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:02.303427 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:02.306200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'name': 'network-vif-deleted', 'tag': '1b368679-537b-47da-af43-37df99edf6f8'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:50:02.308519 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5cf14ba-5bf0-4c3f-b7ad-39f32672a8db" -d '{"events": [{"server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "name": "network-vif-deleted", "tag": "1b368679-537b-47da-af43-37df99edf6f8"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:50:02.324594 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e08085b0-367c-49a0-b013-04e36f48f1d9 req-a3f6dd10-1dbb-4e01-8f8e-8a33ef4001f9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "DELETE /v2.0/ports/1b368679-537b-47da-af43-37df99edf6f8 HTTP/1.1" status: 204  len: 173 time: 0.7821348
Jun 02 16:50:02.355522 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:50:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23543b67-1339-48fe-98aa-787dcd02c267 x-openstack-request-id: req-23543b67-1339-48fe-98aa-787dcd02c267 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:50:02.355991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfbce59d-5fee-4e75-846b-318d9438278f", "name": "network-vif-deleted", "tag": "1b368679-537b-47da-af43-37df99edf6f8", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:50:02.356666 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-23543b67-1339-48fe-98aa-787dcd02c267 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:50:02.357321 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfbce59d-5fee-4e75-846b-318d9438278f', 'name': 'network-vif-deleted', 'tag': '1b368679-537b-47da-af43-37df99edf6f8', 'status': 'completed', 'code': 200}
Jun 02 16:50:02.509473 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-9b82bf29-856e-4149-ad0c-40cd8e940569 req-dd34a76b-1786-4519-af47-143d1f67763f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:50:02.526711 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-9b82bf29-856e-4149-ad0c-40cd8e940569 req-dd34a76b-1786-4519-af47-143d1f67763f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:50:02.528067 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-9b82bf29-856e-4149-ad0c-40cd8e940569 req-dd34a76b-1786-4519-af47-143d1f67763f tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=cfbce59d-5fee-4e75-846b-318d9438278f HTTP/1.1" status: 200  len: 210 time: 0.0629561
Jun 02 16:50:03.364754 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 1b368679-537b-47da-af43-37df99edf6f8 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:03.403779 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 1b368679-537b-47da-af43-37df99edf6f8 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:03.404164 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 1b368679-537b-47da-af43-37df99edf6f8 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:04.512269 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:07.940037 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-9a9a3e0e-49dc-4039-9d77-5a90a5633555 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1815920
Jun 02 16:50:08.098677 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-018891db-6538-476f-a0d6-3ba9563a3fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:08.100182 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-018891db-6538-476f-a0d6-3ba9563a3fda service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1099 time: 0.0785108
Jun 02 16:50:08.121638 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59006) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:08.255097 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-b825bdc4-182a-4b8c-94bf-e6655f5b3c51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:08.255097 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-b825bdc4-182a-4b8c-94bf-e6655f5b3c51 service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1346283
Jun 02 16:50:08.364254 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-9801949e-729a-4768-9700-f27c03638732 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 1001 time: 0.1012220
Jun 02 16:50:08.406752 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port cfb0ca33-bcad-4e73-86d7-22f1e763ed2f {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:08.407048 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:08.431664 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-89fff15f-b19d-4322-ab14-bf27a716cbb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:08.433103 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-89fff15f-b19d-4322-ab14-bf27a716cbb2 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0620227
Jun 02 16:50:08.511073 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-bfee9a39-a7ad-44e0-b8f9-507a01fc46ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:08.512875 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-bfee9a39-a7ad-44e0-b8f9-507a01fc46ed service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725155
Jun 02 16:50:08.528573 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:08.528926 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:08.651941 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for cfb0ca33-bcad-4e73-86d7-22f1e763ed2f owned by network:floatingip {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:08.656402 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-f5b1d330-a9e1-4d4d-837a-aadc5ce0e539 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1365163
Jun 02 16:50:08.785203 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:08.790327 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-27371563-70ff-417a-9bc1-d6b43e9081f2 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:08.793087 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-209d27e0-5c28-4452-915b-9aea3a5f8c3d req-611924cd-e349-4a77-b1fe-38f398839ae1 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303508
Jun 02 16:50:08.834487 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=cfb0ca33-bcad-4e73-86d7-22f1e763ed2f,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:08.860288 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:09.014585 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:09.014840 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Floating IP 1fdb1653-c232-484c-ba7e-bc157fc316bb disassociated (deleted). External IP: 172.27.0.73, port: fb1aaf42-cb49-4b75-8a08-00c10908c38a.
Jun 02 16:50:09.370399 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:09.556075 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:09.567947 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:09.578130 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:09.578355 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:09.578813 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77352af0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:09.634006 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d6d6d342-5c4d-430e-be7c-fdfae4e34dd3 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "DELETE /v2.0/floatingips/1fdb1653-c232-484c-ba7e-bc157fc316bb HTTP/1.1" status: 204  len: 168 time: 1.5109975
Jun 02 16:50:09.634421 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:50:09.636734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f27423dc-02d2-4f85-833c-7ff4366b16e5" -d '{"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:50:09.679711 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:50:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bfbde641-8eee-4290-8223-5c380cf096e1 x-openstack-request-id: req-bfbde641-8eee-4290-8223-5c380cf096e1 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:50:09.680180 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:50:09.680476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-bfbde641-8eee-4290-8223-5c380cf096e1 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:50:09.680925 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'status': 'completed', 'code': 200}
Jun 02 16:50:09.758426 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:09.784971 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-6f912f57-4f0f-466c-9360-a1fb818f9716 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:09.788729 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-6f912f57-4f0f-466c-9360-a1fb818f9716 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=2be2419a57e644b38a5c0ca942660a19&device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 1099 time: 0.0869720
Jun 02 16:50:09.950259 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-6770f42f-0905-439e-b01b-8ce4acfb238d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:09.951694 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-6770f42f-0905-439e-b01b-8ce4acfb238d service neutron] 10.222.0.20 "GET /v2.0/networks?id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 200  len: 911 time: 0.1567380
Jun 02 16:50:10.020955 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-3482cc00-1c12-4efb-87e5-52ce07c41ce3 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 200  len: 217 time: 0.0614350
Jun 02 16:50:10.059728 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb74055e-b18a-4467-b3da-8d6818b42af7 req-ee05bf08-a7df-4b76-a93e-5a23cb6f61a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:10.060744 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-cb74055e-b18a-4467-b3da-8d6818b42af7 req-ee05bf08-a7df-4b76-a93e-5a23cb6f61a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:50:10.077014 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-cb74055e-b18a-4467-b3da-8d6818b42af7 req-ee05bf08-a7df-4b76-a93e-5a23cb6f61a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:50:10.078042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77352af0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:10.078283 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cb74055e-b18a-4467-b3da-8d6818b42af7 req-ee05bf08-a7df-4b76-a93e-5a23cb6f61a9 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1157556
Jun 02 16:50:10.082495 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:10.091043 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:10.092013 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77352af0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:10.093561 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-09abf39b-f233-4993-bbac-49f23d4021e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:10.095022 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-09abf39b-f233-4993-bbac-49f23d4021e7 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 200  len: 849 time: 0.0661719
Jun 02 16:50:10.124533 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-cb74055e-b18a-4467-b3da-8d6818b42af7 req-799cabf8-83e7-4029-b439-99c42da31e68 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406139
Jun 02 16:50:10.170391 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-4db09b7b-3881-447a-9035-6703db66644b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:10.171794 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-4db09b7b-3881-447a-9035-6703db66644b service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=00fea91a-5ad9-4ee8-ae53-59f9858b59ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700846
Jun 02 16:50:10.326289 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:10.423034 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-e812fcfc-d370-430e-a01c-1fc60f9976ac service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2436557
Jun 02 16:50:10.555591 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f27423dc-02d2-4f85-833c-7ff4366b16e5 req-79c23c78-fd7a-4460-99a8-12e8c4def871 service neutron] 10.222.0.20 "GET /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1258130
Jun 02 16:50:10.642189 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77352af0>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:10.646795 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d4c157-1060-42fa-a6fe-9822c6ee6f8e None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:41:23Z', 'revision_number': 4, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': 'a136648f-8d38-4ebc-9c83-dec23c8c9621', 'name': '', 'network_id': '00fea91a-5ad9-4ee8-ae53-59f9858b59ca', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'mac_address': 'fa:16:3e:c3:d4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:21Z', 'updated_at': '2021-06-02T16:41:34Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'subnets': [{'id': 'ca8cd98d-c3e8-45ac-8780-59a7fe077750', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:10.882559 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5906d61d-1eb0-490d-a43b-707cdef5d39a None None] New status for floating IP 1fdb1653-c232-484c-ba7e-bc157fc316bb: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:50:10.950416 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59034) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:11.073220 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.088589 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 02 16:50:11.092743 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Usage tracker for resource:security_group_rule and tenant:0b9fe3b8e536407d851c39a0b2fb999c is out of sync, need to count used quota {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 02 16:50:11.095623 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98278) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 02 16:50:11.101771 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.quota.driver [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98278) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 02 16:50:11.190725 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.196032 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_create {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.204721 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-7632517e-9a60-40d2-88cb-914fa1fe554a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:11.245296 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3206ee70-c331-4c9a-aade-f1a3e99ebf05,revision_number=1']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:11.249393 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0b9fe3b8e536407d851c39a0b2fb999c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2978451
Jun 02 16:50:11.250232 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-6ab07df7-ccb2-44fc-9f59-02153535dd57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:11.252037 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59040) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:11.309135 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.320334 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e096fd-48dd-4166-9ee8-7e0135d62ad5 req-44b371cf-8fa0-46ca-a25e-2835968afb32 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:11.321936 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f7e096fd-48dd-4166-9ee8-7e0135d62ad5 req-44b371cf-8fa0-46ca-a25e-2835968afb32 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.0862353
Jun 02 16:50:11.337270 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.394411 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.399913 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-01219043-fb3f-4dce-9413-d06b09abbf9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:11.412964 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3206ee70-c331-4c9a-aade-f1a3e99ebf05,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:11.416038 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:11.418266 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.422411 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-c83728b7-f31b-4991-813b-28870aa0e827 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3206ee70-c331-4c9a-aade-f1a3e99ebf05 HTTP/1.1" status: 204  len: 168 time: 0.1668823
Jun 02 16:50:11.437779 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-f7e096fd-48dd-4166-9ee8-7e0135d62ad5 req-b531a836-ccc6-4741-bb0d-f797c8120e3b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/security-groups?id=63174eef-3e33-438d-a435-e3f28b518bec&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1097269
Jun 02 16:50:11.463252 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-c1fdbf7e-82be-460e-9218-a3e94d42e499 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:11.465158 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-c1fdbf7e-82be-460e-9218-a3e94d42e499 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 946 time: 0.1240535
Jun 02 16:50:11.614190 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port fb1aaf42-cb49-4b75-8a08-00c10908c38a {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:11.614492 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.757086 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] For port fb1aaf42-cb49-4b75-8a08-00c10908c38a, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=fb1aaf42-cb49-4b75-8a08-00c10908c38a,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:11.757338 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:11.887355 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for fb1aaf42-cb49-4b75-8a08-00c10908c38a owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:11.996834 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:12.002323 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0752bea3-9121-46e9-ad95-e6f7c2297f48 tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:12.050543 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=fb1aaf42-cb49-4b75-8a08-00c10908c38a,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:12.053934 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:12.126121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] No DVR routers for this DVR port fb1aaf42-cb49-4b75-8a08-00c10908c38a on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:12.128646 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:12.131258 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'name': 'network-vif-deleted', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:50:12.133582 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a80e790d-409f-49ed-92f7-0dea230aab1b" -d '{"events": [{"server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "name": "network-vif-deleted", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:50:12.149017 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-e6a58789-c196-40d3-9334-9ee3b8d34519 req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.20 "DELETE /v2.0/ports/fb1aaf42-cb49-4b75-8a08-00c10908c38a HTTP/1.1" status: 204  len: 173 time: 0.6774073
Jun 02 16:50:12.175846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:50:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53a0abb4-1d84-439a-91e0-5678ca1d5d03 x-openstack-request-id: req-53a0abb4-1d84-439a-91e0-5678ca1d5d03 {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:50:12.176170 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914", "name": "network-vif-deleted", "tag": "fb1aaf42-cb49-4b75-8a08-00c10908c38a", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:50:12.176462 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-53a0abb4-1d84-439a-91e0-5678ca1d5d03 {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:50:12.176890 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914', 'name': 'network-vif-deleted', 'tag': 'fb1aaf42-cb49-4b75-8a08-00c10908c38a', 'status': 'completed', 'code': 200}
Jun 02 16:50:12.602979 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1658a3a5-6b2a-4e82-bcc2-81692576d190 req-de97f33d-4a7c-4b99-86e0-53bb0344db18 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Synchronizing usage tracker for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:50:12.620368 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.quota.resource [req-1658a3a5-6b2a-4e82-bcc2-81692576d190 req-de97f33d-4a7c-4b99-86e0-53bb0344db18 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Unset dirty status for tenant:2be2419a57e644b38a5c0ca942660a19 on resource:port {{(pid=98277) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:50:12.621556 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-1658a3a5-6b2a-4e82-bcc2-81692576d190 req-de97f33d-4a7c-4b99-86e0-53bb0344db18 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "GET /v2.0/ports?device_id=bb4ced6b-9d5f-414a-b79d-b3c3bcbeb914 HTTP/1.1" status: 200  len: 210 time: 0.0636632
Jun 02 16:50:13.419393 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device fb1aaf42-cb49-4b75-8a08-00c10908c38a no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:13.460394 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: fb1aaf42-cb49-4b75-8a08-00c10908c38a {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:13.460745 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device fb1aaf42-cb49-4b75-8a08-00c10908c38a not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:13.717090 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59050) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:13.954932 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Deleting port e164cbec-6e1d-4818-9119-889c318d5178 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:13.955186 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.075729 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.076066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.297928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Calling delete_port for e164cbec-6e1d-4818-9119-889c318d5178 owned by network:floatingip {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:14.424449 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.428066 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-2176d89c-673f-42d6-9537-3dd8b7f27164 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:14.470122 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'Port': ['ID=e164cbec-6e1d-4818-9119-889c318d5178,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:14.473150 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:14.564352 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for floatingip, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.584905 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:14.586071 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-d80778b4-44ca-4af0-b7e1-0bec921dbc4b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "DELETE /v2.0/floatingips/5cb68a72-e093-4e8d-af39-4044762ec487 HTTP/1.1" status: 204  len: 168 time: 0.8679638
Jun 02 16:50:15.986886 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59062) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:16.065434 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:16.095246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:16.171996 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:16.176022 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1175a2ba-1401-4674-8647-967ec4c5748a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:16.190992 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=63174eef-3e33-438d-a435-e3f28b518bec,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:16.193512 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:16.205026 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:16.206224 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-9538bdc8-17db-4955-8194-6033371152ad tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] 10.222.0.25 "DELETE /v2.0/security-groups/63174eef-3e33-438d-a435-e3f28b518bec HTTP/1.1" status: 204  len: 168 time: 0.2179952
Jun 02 16:50:16.270341 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59066) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:17.086946 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:17.505402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Deleting port a136648f-8d38-4ebc-9c83-dec23c8c9621 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:17.505736 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:17.632089 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] For port a136648f-8d38-4ebc-9c83-dec23c8c9621, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=a136648f-8d38-4ebc-9c83-dec23c8c9621,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:17.632470 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:17.753674 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Calling delete_port for a136648f-8d38-4ebc-9c83-dec23c8c9621 owned by network:router_interface {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:17.918288 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:17.921944 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-45cca8cb-1330-4743-917c-c52a6adfe52b tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:17.963754 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=a136648f-8d38-4ebc-9c83-dec23c8c9621,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:17.966760 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:18.251039 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:18.722848 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:18.907031 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:18.916248 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Sync routers for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:18.920768 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-229f0e80-f01e-44d3-94f0-7fef5c3311e6 admin admin] 10.222.0.25 "PUT /v2.0/routers/8d9d514f-6911-4666-9f58-7dbc048e1ea3/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6493237
Jun 02 16:50:18.923301 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59070) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:18.925846 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:18.926465 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7730cf40>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:19.095784 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:19.098660 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:19.271448 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:19.344894 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Deleting port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:19.345184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:19.379556 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7730cf40>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:50:17Z', 'revision_number': 5, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port': {'id': '1af8e635-677a-4e1c-8a16-c74d2ec4a2cf', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:8e:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:15Z', 'updated_at': '2021-06-02T16:41:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:19.383993 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Checking router: 8d9d514f-6911-4666-9f58-7dbc048e1ea3 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:19.392627 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Routers {'8d9d514f-6911-4666-9f58-7dbc048e1ea3'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:19.393240 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7730cf40>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:19.467091 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] For port 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:19.467417 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:19.541656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] Set router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 gateway port host: None {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:19.588129 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Calling delete_port for 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:19.646584 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7730cf40>, [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:50:19Z', 'revision_number': 6, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:19.651269 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31250e12-3870-4dd3-b768-3f920c1f1394 None None] The sync data for ids ['8d9d514f-6911-4666-9f58-7dbc048e1ea3'] in dv-cinder-794021-2-iscsi is: [{'id': '8d9d514f-6911-4666-9f58-7dbc048e1ea3', 'name': 'tempest-TestVolumeBootPattern-40169272-router', 'tenant_id': '2be2419a57e644b38a5c0ca942660a19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:11Z', 'updated_at': '2021-06-02T16:50:19Z', 'revision_number': 6, 'project_id': '2be2419a57e644b38a5c0ca942660a19', 'gw_port_host': None}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:19.854180 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:19.859643 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-ad184545-4260-4752-a7a7-266e6b4bff63 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:19.905540 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Pushing event deleted for resources: {'Port': ['ID=1af8e635-677a-4e1c-8a16-c74d2ec4a2cf,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:19.908577 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:19.999045 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.185463 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.187730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.214792 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.215336 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8d9d514f-6911-4666-9f58-7dbc048e1ea3 {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:50:20.227709 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.228825 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b0d4659c-b79d-4a1c-af8d-cebc7915899e admin admin] 10.222.0.25 "DELETE /v2.0/routers/8d9d514f-6911-4666-9f58-7dbc048e1ea3 HTTP/1.1" status: 204  len: 168 time: 1.3046567
Jun 02 16:50:20.231352 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59072) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:20.290496 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Deleting subnet ca8cd98d-c3e8-45ac-8780-59a7fe077750 {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:50:20.293478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.342059 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.399595 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device a136648f-8d38-4ebc-9c83-dec23c8c9621 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:20.430194 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.476170 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: a136648f-8d38-4ebc-9c83-dec23c8c9621 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:20.476553 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device a136648f-8d38-4ebc-9c83-dec23c8c9621 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:20.685568 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.689573 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c2cc0d25-06e0-4af4-9315-a435d46d65fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:20.727321 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ca8cd98d-c3e8-45ac-8780-59a7fe077750,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:20.730283 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:20.731264 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.737315 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22380ecb-2aa2-439e-952c-18a73198c89d None None] Network 00fea91a-5ad9-4ee8-ae53-59f9858b59ca requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:50:20.737873 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-da5467c2-4317-4b6f-a415-f2b8a980d2e6 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/ca8cd98d-c3e8-45ac-8780-59a7fe077750 HTTP/1.1" status: 204  len: 168 time: 0.5051677
Jun 02 16:50:20.740175 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59074) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:20.846483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:20.918861 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Deleting port 00a534d8-55b3-4d1f-8291-a45a4debf37e {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:20.919191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.017393 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] For port 00a534d8-55b3-4d1f-8291-a45a4debf37e, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=00a534d8-55b3-4d1f-8291-a45a4debf37e,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:21.017749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.026196 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] DHCP port deletion for 00fea91a-5ad9-4ee8-ae53-59f9858b59ca request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:50:21.093901 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Deleting port 00a534d8-55b3-4d1f-8291-a45a4debf37e {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:21.094263 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.140801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Calling delete_port for 00a534d8-55b3-4d1f-8291-a45a4debf37e owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:21.189770 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] For port 00a534d8-55b3-4d1f-8291-a45a4debf37e, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=00a534d8-55b3-4d1f-8291-a45a4debf37e,segment=NetworkSegment(335c4705-6fdd-4973-9624-acc92747502c),segment_id=335c4705-6fdd-4973-9624-acc92747502c)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:21.190156 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.199887 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.205483 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-276bac06-3186-461c-b624-7db9fd45fb05 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:21.318871 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Calling delete_port for 00a534d8-55b3-4d1f-8291-a45a4debf37e owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:21.354856 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Pushing event deleted for resources: {'Port': ['ID=00a534d8-55b3-4d1f-8291-a45a4debf37e,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:21.356629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] No DVR routers for this DVR port 00a534d8-55b3-4d1f-8291-a45a4debf37e on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:21.358165 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:21.365119 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.369335 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:21.411951 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Pushing event deleted for resources: {'Port': ['ID=00a534d8-55b3-4d1f-8291-a45a4debf37e,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:21.416800 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] No DVR routers for this DVR port 00a534d8-55b3-4d1f-8291-a45a4debf37e on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:21.426494 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.426830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.427227 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.427535 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.427868 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.428195 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.428517 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.428836 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.429225 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.429542 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.429884 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.430197 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98279) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:21.433305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:21.473786 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.487097 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b769a9f40>,) {'filters': {'network_id': ['00fea91a-5ad9-4ee8-ae53-59f9858b59ca']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:21.498966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b769a9f40>, '335c4705-6fdd-4973-9624-acc92747502c') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:21.499259 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b769a9f40>, '335c4705-6fdd-4973-9624-acc92747502c') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:21.510537 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.526652 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.533038 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Releasing vlan 688 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:50:21.533532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:50:21.547042 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:50:21.626842 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.630737 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:21.643679 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:21.654489 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Pushing event deleted for resources: {'Network': ['ID=00fea91a-5ad9-4ee8-ae53-59f9858b59ca,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:21.657543 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:21.669087 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-d8b68b7f-1642-48c9-be87-7c5bf6d97f9b admin admin] 10.222.0.25 "DELETE /v2.0/networks/00fea91a-5ad9-4ee8-ae53-59f9858b59ca HTTP/1.1" status: 204  len: 168 time: 0.9279459
Jun 02 16:50:21.672324 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59076) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:21.881280 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:21.918026 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:21.918375 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 1af8e635-677a-4e1c-8a16-c74d2ec4a2cf not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:21.918830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 00a534d8-55b3-4d1f-8291-a45a4debf37e no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:21.952063 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 00a534d8-55b3-4d1f-8291-a45a4debf37e {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:21.952406 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 00a534d8-55b3-4d1f-8291-a45a4debf37e not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:22.231021 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:22.652625 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Deleting port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:22.652929 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:22.771928 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.db [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] For port 0edec0c6-96bd-4edc-bbb7-22919b9b88b6, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98278) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:22.772741 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:23.007734 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Calling delete_port for 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 owned by network:router_interface {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:23.159643 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:23.164017 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-d854a8ab-7b9a-4a16-9bbc-b11b94bb72e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:23.209339 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Pushing event deleted for resources: {'Port': ['ID=0edec0c6-96bd-4edc-bbb7-22919b9b88b6,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:23.235956 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:23.490025 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:23.852235 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Router e93b0099-718d-481a-becb-9609450b08d5 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:24.032265 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:24.040769 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Sync routers for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:24.042832 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-48e0a63c-c9c8-4089-b7b1-565bba49df95 admin admin] 10.222.0.25 "PUT /v2.0/routers/e93b0099-718d-481a-becb-9609450b08d5/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3693757
Jun 02 16:50:24.045574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59078) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:24.049984 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:24.050596 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18a9a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:24.224579 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:24.228968 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:24.392834 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:24.472117 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Deleting port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:24.472423 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:24.507655 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18a9a0>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64'}], 'enable_snat': True}, 'gw_port_id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:50:23Z', 'revision_number': 5, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port': {'id': '7a74e070-e05b-4476-9b2b-ebdd5aeee5d2', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:31:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e93b0099-718d-481a-becb-9609450b08d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.64', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:41:31Z', 'updated_at': '2021-06-02T16:41:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:24.511529 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Checking router: e93b0099-718d-481a-becb-9609450b08d5 for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:24.520208 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Routers {'e93b0099-718d-481a-becb-9609450b08d5'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:24.520877 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18a9a0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:49:58Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['e93b0099-718d-481a-becb-9609450b08d5'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:24.594063 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] For port 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:24.594424 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:24.669172 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] Set router e93b0099-718d-481a-becb-9609450b08d5 gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:24.714288 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Calling delete_port for 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:24.806137 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7c18a9a0>, [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:50:24Z', 'revision_number': 6, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:24.810378 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b518cc0b-6d55-4b8b-84fb-8696a2cae753 None None] The sync data for ids ['e93b0099-718d-481a-becb-9609450b08d5'] in dv-cinder-794021-2-iscsi is: [{'id': 'e93b0099-718d-481a-becb-9609450b08d5', 'name': 'tempest-TestVolumeBootPattern-179469675-router', 'tenant_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:41:29Z', 'updated_at': '2021-06-02T16:50:24Z', 'revision_number': 6, 'project_id': '1be1536c4ea0412a9c5fbd5dc1f04d9f', 'gw_port_host': None}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:24.853590 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:24.857226 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5f1208ea-73f2-4243-9b64-4cce2323fb17 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:24.900884 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Pushing event deleted for resources: {'Port': ['ID=7a74e070-e05b-4476-9b2b-ebdd5aeee5d2,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:24.903906 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:24.997801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.287542 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.289905 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.324124 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.324778 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e93b0099-718d-481a-becb-9609450b08d5 {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:50:25.337587 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.338733 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-40ce4d88-7d60-4062-89a9-f07ec8dafd12 admin admin] 10.222.0.25 "DELETE /v2.0/routers/e93b0099-718d-481a-becb-9609450b08d5 HTTP/1.1" status: 204  len: 168 time: 1.2921491
Jun 02 16:50:25.342300 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59080) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:25.401364 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Deleting subnet 866a4c65-75ff-4446-b1dc-0dbfdf1b68a4 {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:50:25.405001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.455329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.537173 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.785701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.790777 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:25.803468 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-890351f4-684f-4c75-8f5b-3aacb2be5f1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.825445 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=866a4c65-75ff-4446-b1dc-0dbfdf1b68a4,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:25.827533 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.830629 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:25.834969 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-69a5cf4b-9c6d-432e-b8ff-bcb5e7752329 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/866a4c65-75ff-4446-b1dc-0dbfdf1b68a4 HTTP/1.1" status: 204  len: 168 time: 0.4917109
Jun 02 16:50:25.836559 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c4813be-674b-436a-876c-5dd1e233509c None None] Network 2e981188-5c9f-4f7b-87dd-07a67b33db56 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:50:25.837434 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59082) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:25.919173 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:25.941001 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:25.965803 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:25.966061 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 0edec0c6-96bd-4edc-bbb7-22919b9b88b6 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:25.966469 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:26.012204 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Deleting port 74d834d9-79d2-4849-93a5-fa462268dcb2 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:26.012541 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.056471 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:26.056471 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 7a74e070-e05b-4476-9b2b-ebdd5aeee5d2 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:26.116180 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] For port 74d834d9-79d2-4849-93a5-fa462268dcb2, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=74d834d9-79d2-4849-93a5-fa462268dcb2,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:26.116637 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.152621 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] DHCP port deletion for 2e981188-5c9f-4f7b-87dd-07a67b33db56 request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:50:26.220678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Deleting port 74d834d9-79d2-4849-93a5-fa462268dcb2 {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:26.221065 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.243443 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Calling delete_port for 74d834d9-79d2-4849-93a5-fa462268dcb2 owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:26.293079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.297088 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-0e15068d-ba05-4b86-b399-8b440651b23f tempest-VolumesNegativeTest-731697924 tempest-VolumesNegativeTest-731697924-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:26.324076 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] For port 74d834d9-79d2-4849-93a5-fa462268dcb2, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=74d834d9-79d2-4849-93a5-fa462268dcb2,segment=NetworkSegment(daa33d4f-6557-48f8-8364-408b98ddd67f),segment_id=daa33d4f-6557-48f8-8364-408b98ddd67f)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:26.324543 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.342685 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Pushing event deleted for resources: {'Port': ['ID=74d834d9-79d2-4849-93a5-fa462268dcb2,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:26.346036 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:26.348319 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] No DVR routers for this DVR port 74d834d9-79d2-4849-93a5-fa462268dcb2 on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:26.448597 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Calling delete_port for 74d834d9-79d2-4849-93a5-fa462268dcb2 owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:26.471918 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.485781 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b779c72b0>,) {'filters': {'network_id': ['2e981188-5c9f-4f7b-87dd-07a67b33db56']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:26.491619 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.495333 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:26.499330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b779c72b0>, 'daa33d4f-6557-48f8-8364-408b98ddd67f') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:26.499618 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b779c72b0>, 'daa33d4f-6557-48f8-8364-408b98ddd67f') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:26.511018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.527326 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.533532 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Releasing vlan 652 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:50:26.533943 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.537206 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Pushing event deleted for resources: {'Port': ['ID=74d834d9-79d2-4849-93a5-fa462268dcb2,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:26.540393 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:26.541201 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-376d64fd-238a-4838-83c3-bc208414b184 None None] No DVR routers for this DVR port 74d834d9-79d2-4849-93a5-fa462268dcb2 on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:50:26.551870 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:50:26.650918 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.656772 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.659467 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:26.685691 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Pushing event deleted for resources: {'Network': ['ID=2e981188-5c9f-4f7b-87dd-07a67b33db56,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:26.688649 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:26.690148 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-844ddd62-5496-42a7-932d-d97220dde35d admin admin] 10.222.0.25 "DELETE /v2.0/networks/2e981188-5c9f-4f7b-87dd-07a67b33db56 HTTP/1.1" status: 204  len: 168 time: 0.8518119
Jun 02 16:50:26.824076 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59086) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:26.874600 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-977aacf7-efef-40b1-8b15-cd647bfbc8b1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2be2419a57e644b38a5c0ca942660a19&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0493133
Jun 02 16:50:26.878284 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59088) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:26.949079 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:26.985061 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.038707 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.042606 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-035fddba-87e0-4a5e-a090-2a096c254be2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:27.057167 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a0b351d-1055-4e55-8c34-de4c44baaa67,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:27.062246 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:27.063869 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.064926 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-90d15abf-cd12-46a4-b69c-d160d80099b6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7a0b351d-1055-4e55-8c34-de4c44baaa67 HTTP/1.1" status: 204  len: 168 time: 0.1857846
Jun 02 16:50:27.441265 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59094) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:27.604663 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-bcc894f8-ab28-42d5-901d-7a17fa2dea3b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1be1536c4ea0412a9c5fbd5dc1f04d9f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1621225
Jun 02 16:50:27.607253 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59096) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:27.669333 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.698471 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.759249 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.763269 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-3e71e90c-ee11-4890-8ea2-baf65bd6b091 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:27.774920 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7694e2c-e734-448f-9bde-fbb59534dce7,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:27.778701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:27.785730 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:27.786878 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c367203b-a028-4dd0-9b0c-84cb379b8da7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d7694e2c-e734-448f-9bde-fbb59534dce7 HTTP/1.1" status: 204  len: 168 time: 0.1786861
Jun 02 16:50:27.880001 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 74d834d9-79d2-4849-93a5-fa462268dcb2 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:27.914014 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 74d834d9-79d2-4849-93a5-fa462268dcb2 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:27.914363 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 74d834d9-79d2-4849-93a5-fa462268dcb2 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:28.510187 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-66c04b6f-f4af-4910-a95a-34fda35aa55e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:28.747676 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:30.239899 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:31.874522 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:34.557221 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:37.606345 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:50:41.896990 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59100) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:42.262238 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Deleting port 20ce37e7-f7be-4337-9068-bc20bdc4c44d {{(pid=98278) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:42.262476 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:42.381833 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:42.382163 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:42.504746 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.plugins.ml2.plugin [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Calling delete_port for 20ce37e7-f7be-4337-9068-bc20bdc4c44d owned by network:floatingip {{(pid=98278) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:42.644400 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1737991'] for port, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:42.648173 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-380df4bc-9b19-4bcf-b03c-39fdc176f762 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:42.691291 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event deleted for resources: {'Port': ['ID=20ce37e7-f7be-4337-9068-bc20bdc4c44d,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:42.729019 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.729377 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.729765 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.730132 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.730494 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.730842 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.731198 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.731554 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.731923 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.732272 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.732619 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.732969 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:42.740447 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:42.800019 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for floatingip, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:42.800392 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.db.l3_db [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Floating IP c3789ea7-c4ef-45a9-9f11-3d7a1fb33021 disassociated (deleted). External IP: 172.27.0.229, port: 4a1c5267-6d2d-4f20-832f-b6d07dd9c926.
Jun 02 16:50:43.154224 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98278) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:43.364530 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98278) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:43.376392 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Sync routers for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:43.386507 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:43.386977 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for floatingip, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:43.387264 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43490>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:43.443498 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-5423caa1-6490-4710-b5b3-fa22fc05bcfe tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "DELETE /v2.0/floatingips/c3789ea7-c4ef-45a9-9f11-3d7a1fb33021 HTTP/1.1" status: 204  len: 168 time: 1.5451996
Jun 02 16:50:43.444185 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98278) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:50:43.446608 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}697738948ef1913993effef6a4420c4833929dff7c61a4c2c27483b25b1dd279" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41fca8cf-27fd-4aa4-bb72-509ae42e5475" -d '{"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98278) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:50:43.507269 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 02 Jun 2021 16:50:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ecb2c5fb-3ecd-4382-b057-db368adbf048 x-openstack-request-id: req-ecb2c5fb-3ecd-4382-b057-db368adbf048 {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:50:43.508278 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "status": "completed", "code": 200}]} {{(pid=98278) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:50:43.508897 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ecb2c5fb-3ecd-4382-b057-db368adbf048 {{(pid=98278) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:50:43.509721 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'status': 'completed', 'code': 200}
Jun 02 16:50:43.570389 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:43.610037 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-c0972ab9-d193-47df-9239-7f06961d067f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:43.611544 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-c0972ab9-d193-47df-9239-7f06961d067f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 1098 time: 0.0792015
Jun 02 16:50:43.768862 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-a5b2713d-34d1-40c6-a3ab-81a6ff59aae5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:43.770514 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-a5b2713d-34d1-40c6-a3ab-81a6ff59aae5 service neutron] 10.222.0.20 "GET /v2.0/networks?id=424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 200  len: 910 time: 0.1529765
Jun 02 16:50:43.878333 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-ea9d0ff0-2eeb-4c83-9c38-70c3571e4e93 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 200  len: 217 time: 0.0983958
Jun 02 16:50:43.906330 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43490>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:43.910559 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Checking router: 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:43.919305 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:43.919920 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43490>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:43.963656 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-4b184dde-d843-4fa4-87e4-9cc6e49c0b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:43.965009 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-4b184dde-d843-4fa4-87e4-9cc6e49c0b6b service neutron] 10.222.0.20 "GET /v2.0/subnets?id=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 200  len: 848 time: 0.0756402
Jun 02 16:50:44.026618 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58bc0e75-f62c-4927-8b33-e6b9637384cc req-5d049515-13ab-4466-a883-628c12efdc43 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:44.028168 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-58bc0e75-f62c-4927-8b33-e6b9637384cc req-5d049515-13ab-4466-a883-628c12efdc43 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.1930213
Jun 02 16:50:44.066084 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-599f1fd9-5c4b-40bf-8a48-41d9fede0498 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:44.067643 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-599f1fd9-5c4b-40bf-8a48-41d9fede0498 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=424e3c29-adf6-44ca-a36f-5399047a7f0c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0951114
Jun 02 16:50:44.115199 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:44.212545 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-fa965e2f-b28f-4233-ae7d-f02cf35f8ccb service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1371069
Jun 02 16:50:44.381930 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-58bc0e75-f62c-4927-8b33-e6b9637384cc req-66cfd6c4-f346-43db-8acd-16609b55791e tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3474646
Jun 02 16:50:44.386134 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-41fca8cf-27fd-4aa4-bb72-509ae42e5475 req-94fba43e-d2ad-492e-8579-c0aea667ed16 service neutron] 10.222.0.20 "GET /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1659009
Jun 02 16:50:44.441811 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b77f43490>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:44.445895 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055c9a4-11fd-4c6e-a841-ab1e3c91ad88 None None] The sync data for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi is: [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:45:29Z', 'revision_number': 4, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi', '_interfaces': [{'id': '916e1087-9c2c-4810-8927-cdee4290b02b', 'name': '', 'network_id': '424e3c29-adf6-44ca-a36f-5399047a7f0c', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'mac_address': 'fa:16:3e:fd:8c:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:27Z', 'updated_at': '2021-06-02T16:45:41Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'subnets': [{'id': '0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:44.672104 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eac18944-2e66-452e-9749-7dd79ab60308 None None] New status for floating IP c3789ea7-c4ef-45a9-9f11-3d7a1fb33021: DOWN {{(pid=98280) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 02 16:50:45.282947 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40915691-4b78-47a9-a793-74ed352ca668 req-42c34e16-a88e-4c84-8f9c-49783a397a8f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98277) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:45.284295 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40915691-4b78-47a9-a793-74ed352ca668 req-42c34e16-a88e-4c84-8f9c-49783a397a8f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.20 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0869362
Jun 02 16:50:45.423746 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Deleting port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:45.424088 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:45.555792 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] For port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926, host hv-cinder-79402, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79402',level=0,port_id=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:45.556184 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:45.575619 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73343bb6-7d54-4a21-9983-7f2b79df0e11 req-720dd78d-f3f3-451a-a9e2-08b4900f4ecf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98278) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 02 16:50:45.576292 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-73343bb6-7d54-4a21-9983-7f2b79df0e11 req-720dd78d-f3f3-451a-a9e2-08b4900f4ecf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Synchronizing usage tracker for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98278) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 02 16:50:45.591885 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.quota.resource [req-73343bb6-7d54-4a21-9983-7f2b79df0e11 req-720dd78d-f3f3-451a-a9e2-08b4900f4ecf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Unset dirty status for tenant:b110174a94dd4df89cc6dc7b34bb7170 on resource:port {{(pid=98278) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 02 16:50:45.593093 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73343bb6-7d54-4a21-9983-7f2b79df0e11 req-720dd78d-f3f3-451a-a9e2-08b4900f4ecf tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 945 time: 0.0940580
Jun 02 16:50:45.643169 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-73343bb6-7d54-4a21-9983-7f2b79df0e11 req-708242d8-9945-45d3-bab1-870b1b123f2f tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/security-groups?id=15573404-5194-40a3-a9d2-cd9bc27c9c66&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414886
Jun 02 16:50:45.679634 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Calling delete_port for 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 owned by compute:nova {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:45.794119 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:45.799749 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-94f2f3ac-8f1c-478d-b65c-fb39f342fd6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:45.944466 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event deleted for resources: {'Port': ['ID=4a1c5267-6d2d-4f20-832f-b6d07dd9c926,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:45.947675 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:46.018191 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] No DVR routers for this DVR port 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 on host hv-cinder-79402 {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:46.020937 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1008223'] for port, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:46.023633 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-deleted', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926'}] {{(pid=98277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 02 16:50:46.026058 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d3dc9640ffc195f3c1c63dae2649e521ae0d04de0514396d0fe6d933849e845" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b16bf55-d070-4fbc-8af3-a8370cca3e0d" -d '{"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-deleted", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926"}]}' {{(pid=98277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 02 16:50:46.040659 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [req-40915691-4b78-47a9-a793-74ed352ca668 req-5a0ac6f7-fe95-49da-9b17-8416a19df4a8 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.20 "DELETE /v2.0/ports/4a1c5267-6d2d-4f20-832f-b6d07dd9c926 HTTP/1.1" status: 204  len: 173 time: 0.7508101
Jun 02 16:50:46.211402 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 02 Jun 2021 16:50:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc4a5a89-fcb7-44b4-819e-437d8ec6807c x-openstack-request-id: req-dc4a5a89-fcb7-44b4-819e-437d8ec6807c {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 02 16:50:46.211734 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ca1fe71-0e58-4997-b7e0-e18d1b3c009a", "name": "network-vif-deleted", "tag": "4a1c5267-6d2d-4f20-832f-b6d07dd9c926", "status": "completed", "code": 200}]} {{(pid=98277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 02 16:50:46.212169 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-dc4a5a89-fcb7-44b4-819e-437d8ec6807c {{(pid=98277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 02 16:50:46.212787 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ca1fe71-0e58-4997-b7e0-e18d1b3c009a', 'name': 'network-vif-deleted', 'tag': '4a1c5267-6d2d-4f20-832f-b6d07dd9c926', 'status': 'completed', 'code': 200}
Jun 02 16:50:46.821207 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [req-974f94a2-37d3-4f7d-adee-3ead906caab8 req-5dbefe68-89ca-4777-84e0-8415d4aa6ae0 tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "GET /v2.0/ports?device_id=7ca1fe71-0e58-4997-b7e0-e18d1b3c009a HTTP/1.1" status: 200  len: 210 time: 0.0439723
Jun 02 16:50:47.730071 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 no longer exists at agent hyperv_hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:47.768054 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] No Port match for: 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:47.768398 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Device 4a1c5267-6d2d-4f20-832f-b6d07dd9c926 not bound to the agent host hv-cinder-79402 {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:47.919880 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59122) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:47.990517 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:48.019884 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:48.099174 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:48.104865 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-50836dba-c741-4ca8-9975-2d608735ff5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:48.218916 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=15573404-5194-40a3-a9d2-cd9bc27c9c66,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:48.221840 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:48.229192 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] Notify callbacks [] for security_group, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:48.230344 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-b80f0277-815a-4ead-964a-1307c624f6db tempest-TestShelveInstance-1408015174 tempest-TestShelveInstance-1408015174-project] 10.222.0.25 "DELETE /v2.0/security-groups/15573404-5194-40a3-a9d2-cd9bc27c9c66 HTTP/1.1" status: 204  len: 168 time: 0.3095026
Jun 02 16:50:48.280396 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59126) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:48.956922 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:49.368291 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Deleting port 916e1087-9c2c-4810-8927-cdee4290b02b {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:49.369176 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:49.489872 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] For port 916e1087-9c2c-4810-8927-cdee4290b02b, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=916e1087-9c2c-4810-8927-cdee4290b02b,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:49.490174 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:49.614484 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Calling delete_port for 916e1087-9c2c-4810-8927-cdee4290b02b owned by network:router_interface {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:49.880601 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:49.886359 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-7f38f949-0039-4dd9-acbb-6c46492036ac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:49.936474 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Pushing event deleted for resources: {'Port': ['ID=916e1087-9c2c-4810-8927-cdee4290b02b,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:49.940121 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:50.204265 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:50.561116 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:50.744182 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:50.752728 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Sync routers for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:50.756472 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] 10.222.0.25 "PUT /v2.0/routers/6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4749188
Jun 02 16:50:50.759042 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59130) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:50.766056 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:50.766675 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b772be5b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:50.932219 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:50.942002 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: dv-cinder-794021-2-iscsi {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:51.234187 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:51.280427 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b772be5b0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:50:49Z', 'revision_number': 5, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port': {'id': 'e1995789-755d-40e6-abbe-114db4d51d26', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:b0:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:24Z', 'updated_at': '2021-06-02T16:45:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:51.284293 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Checking router: 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 for host: dv-cinder-794021-2-iscsi {{(pid=98279) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:51.292593 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Routers {'6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98279) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:51.293100 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b772be5b0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'], 'active': True} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:51.307272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Deleting port e1995789-755d-40e6-abbe-114db4d51d26 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:51.307589 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:51.453181 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvr_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] Set router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 gateway port host: None {{(pid=98279) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:51.456034 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] For port e1995789-755d-40e6-abbe-114db4d51d26, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=e1995789-755d-40e6-abbe-114db4d51d26,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:51.456376 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:51.560695 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_hamode_db [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b772be5b0>, [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:50:51Z', 'revision_number': 6, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98279) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:51.565117 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78afe2b-63f3-46b9-89cb-61d77d5f9b67 None None] The sync data for ids ['6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1'] in dv-cinder-794021-2-iscsi is: [{'id': '6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1', 'name': 'tempest-TestShelveInstance-2094890525-router', 'tenant_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:23Z', 'updated_at': '2021-06-02T16:50:51Z', 'revision_number': 6, 'project_id': 'b110174a94dd4df89cc6dc7b34bb7170', 'gw_port_host': None}] {{(pid=98279) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:51.582846 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Calling delete_port for e1995789-755d-40e6-abbe-114db4d51d26 owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:51.743180 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:51.747057 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-966993ca-70d2-4166-a3d1-aceace667867 tempest-TestVolumeBootPattern-929421616 tempest-TestVolumeBootPattern-929421616-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:51.790084 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Pushing event deleted for resources: {'Port': ['ID=e1995789-755d-40e6-abbe-114db4d51d26,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:51.793328 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:51.901050 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.073321 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.075726 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.102272 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.102548 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:50:52.115137 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.116239 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-c0842190-2af7-4e4e-9077-9c737ef45353 admin admin] 10.222.0.25 "DELETE /v2.0/routers/6e62e465-87e1-4cc7-a0a0-dd9f3635d8d1 HTTP/1.1" status: 204  len: 168 time: 1.3562725
Jun 02 16:50:52.119003 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59132) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:52.177520 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.db_base_plugin_v2 [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Deleting subnet 0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 {{(pid=98277) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:50:52.180707 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.231677 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10725963'] for subnet, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.308201 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.353491 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 916e1087-9c2c-4810-8927-cdee4290b02b no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:52.387781 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 916e1087-9c2c-4810-8927-cdee4290b02b {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:52.388240 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 916e1087-9c2c-4810-8927-cdee4290b02b not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:52.571099 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-11423319', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12252993'] for subnet, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.575868 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:52.610928 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:52.614087 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:52.616639 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for subnet, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.623240 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d109bb8d-7808-4f97-9011-9903e0373d0c None None] Network 424e3c29-adf6-44ca-a36f-5399047a7f0c requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:50:52.631811 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-b4707388-cae5-4398-9225-b8a7317c29a7 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/0a4dbcbb-4c3a-4884-bb37-d99c2a0142b9 HTTP/1.1" status: 204  len: 168 time: 0.5096374
Jun 02 16:50:52.632446 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59134) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:52.736791 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.812966 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Deleting port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:52.813336 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.884914 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] DHCP port deletion for 424e3c29-adf6-44ca-a36f-5399047a7f0c request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:50:52.917017 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] For port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:52.917370 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:52.963410 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Deleting port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:52.964035 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.069416 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] For port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,segment=NetworkSegment(179e8978-8edc-4f99-a70d-1f4e8d45205a),segment_id=179e8978-8edc-4f99-a70d-1f4e8d45205a)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:53.069830 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.148831 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Calling delete_port for ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:53.193002 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Calling delete_port for ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:53.199875 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.203880 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1ac15c14-af7e-4651-b6f0-ad9bfa3f6bac tempest-TestMinimumBasicScenario-1247101252 tempest-TestMinimumBasicScenario-1247101252-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:53.239465 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.244077 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:53.246821 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Pushing event deleted for resources: {'Port': ['ID=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:53.249891 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:53.254652 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] No DVR routers for this DVR port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:53.288676 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Pushing event deleted for resources: {'Port': ['ID=ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:53.290577 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] No DVR routers for this DVR port ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:53.291986 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-ab4e0578-c6e1-4a56-8dfe-2956cab4139f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:53.372701 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.385569 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b778a7b20>,) {'filters': {'network_id': ['424e3c29-adf6-44ca-a36f-5399047a7f0c']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:53.398048 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b778a7b20>, '179e8978-8edc-4f99-a70d-1f4e8d45205a') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:53.398285 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b778a7b20>, '179e8978-8edc-4f99-a70d-1f4e8d45205a') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:53.410193 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.429330 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.435954 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Releasing vlan 665 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:50:53.436343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:50:53.449486 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:50:53.547202 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.555327 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:53.559094 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:53.581375 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Pushing event deleted for resources: {'Network': ['ID=424e3c29-adf6-44ca-a36f-5399047a7f0c,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:53.585426 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:53.592455 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-1a4fa803-e620-4602-b5a1-84231e640e9c admin admin] 10.222.0.25 "DELETE /v2.0/networks/424e3c29-adf6-44ca-a36f-5399047a7f0c HTTP/1.1" status: 204  len: 168 time: 0.9594536
Jun 02 16:50:53.595634 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59136) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:53.892895 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e1995789-755d-40e6-abbe-114db4d51d26 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:53.926984 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: e1995789-755d-40e6-abbe-114db4d51d26 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:53.927383 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device e1995789-755d-40e6-abbe-114db4d51d26 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:53.927861 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:53.959697 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:53.960042 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device ccfc8b2b-5b7f-4ef1-8f26-3c2f8448fead not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:54.154824 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-694054'] for router_interface, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:54.683450 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Deleting port 81617133-7b9e-4431-b711-b9f0f8b88381 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:54.683924 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:54.810296 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] For port 81617133-7b9e-4431-b711-b9f0f8b88381, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=81617133-7b9e-4431-b711-b9f0f8b88381,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:54.810641 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:54.930595 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Calling delete_port for 81617133-7b9e-4431-b711-b9f0f8b88381 owned by network:router_interface {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:55.097819 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:55.101576 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-69b4b0d5-b770-4220-8ae0-d9ac6dd0a0e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:55.145916 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Pushing event deleted for resources: {'Port': ['ID=81617133-7b9e-4431-b711-b9f0f8b88381,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:55.191015 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.191720 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.191720 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.192074 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.192407 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.192772 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.193115 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.193451 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.193830 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.194189 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.194565 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.194865 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-794021-2-iscsi {{(pid=98277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 02 16:50:55.223879 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:55.429698 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-535864', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-694098'] for router_interface, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:55.802602 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-b6cddccb-f1a1-4c95-bf6a-cf4c3a106cdb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:55.819527 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd has already been hosted by L3 agent d94c3686-52fd-4c45-b66d-abcea2d1e484 {{(pid=98277) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 02 16:50:56.002329 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] Notify agent at l3_agent.dv-cinder-794021-2-iscsi the message routers_updated {{(pid=98277) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 02 16:50:56.010662 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Sync routers for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 02 16:50:56.015528 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-aa6c253e-0ae5-44b9-b4f3-436caea1d179 admin admin] 10.222.0.25 "PUT /v2.0/routers/14ec93d3-21ec-4da3-9ab3-dbec95f193dd/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4165189
Jun 02 16:50:56.015979 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59138) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:56.021814 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:56.022431 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cdb0eb0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:56.197897 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: dv-cinder-794021-2-iscsi {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:56.295175 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks [] for router, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:56.464767 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:56.482537 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cdb0eb0>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'external_fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15'}], 'enable_snat': True}, 'gw_port_id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:50:55Z', 'revision_number': 5, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port': {'id': 'c70570f0-64ed-4a79-a12f-1b21f13eeb3a', 'name': '', 'network_id': '111563ce-426b-47b0-ac88-407bffa30df5', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:2f:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'ip_address': '172.27.0.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-794021-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-02T16:45:34Z', 'updated_at': '2021-06-02T16:45:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '7e7273ca-7a6e-4dbc-a88a-c692752bdd51', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-794021-2-iscsi'}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:56.486347 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Checking router: 14ec93d3-21ec-4da3-9ab3-dbec95f193dd for host: dv-cinder-794021-2-iscsi {{(pid=98280) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 02 16:50:56.494832 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Routers {'14ec93d3-21ec-4da3-9ab3-dbec95f193dd'} bound to L3 agent in host dv-cinder-794021-2-iscsi {{(pid=98280) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 02 16:50:56.495846 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f9b7cdb0eb0>, 'dv-cinder-794021-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-02T16:31:58Z,description=<?>,heartbeat_timestamp=2021-06-02T16:50:28Z,host='dv-cinder-794021-2-iscsi',id=d94c3686-52fd-4c45-b66d-abcea2d1e484,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-02T16:31:58Z,topic='l3_agent')) {'router_ids': ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'], 'active': True} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:56.539651 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Deleting port c70570f0-64ed-4a79-a12f-1b21f13eeb3a {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:56.540018 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:56.645133 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_dvr_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] Set router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd gateway port host: None {{(pid=98280) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 02 16:50:56.664632 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] For port c70570f0-64ed-4a79-a12f-1b21f13eeb3a, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,segment=NetworkSegment(234bfbc8-daac-48b7-b048-c18c5c7873a6),segment_id=234bfbc8-daac-48b7-b048-c18c5c7873a6)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:56.664980 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:56.750781 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.l3_hamode_db [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f9b7cdb0eb0>, [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:50:56Z', 'revision_number': 6, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port_host': None}], 'dv-cinder-794021-2-iscsi', False) {} {{(pid=98280) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:56.755153 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e701eb89-8686-4627-9379-39d676d8e9a3 None None] The sync data for ids ['14ec93d3-21ec-4da3-9ab3-dbec95f193dd'] in dv-cinder-794021-2-iscsi is: [{'id': '14ec93d3-21ec-4da3-9ab3-dbec95f193dd', 'name': 'tempest-TestShelveInstance-1857741650-router', 'tenant_id': 'c649aeae15ef49fab852d41fce91f791', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-02T16:45:32Z', 'updated_at': '2021-06-02T16:50:56Z', 'revision_number': 6, 'project_id': 'c649aeae15ef49fab852d41fce91f791', 'gw_port_host': None}] {{(pid=98280) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 02 16:50:56.793373 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Calling delete_port for c70570f0-64ed-4a79-a12f-1b21f13eeb3a owned by network:router_gateway {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:56.934700 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:56.941478 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-214c0cd4-16ff-40fc-8dc3-a65fa52c5b80 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:56.990574 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Pushing event deleted for resources: {'Port': ['ID=c70570f0-64ed-4a79-a12f-1b21f13eeb3a,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:57.016067 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:57.079041 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683719'] for router_gateway, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.259862 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-761405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2046'] for router, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.262188 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.285718 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-761513'] for router, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.286427 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 14ec93d3-21ec-4da3-9ab3-dbec95f193dd {{(pid=98277) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 02 16:50:57.302100 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] Notify callbacks [] for router, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.303227 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-17d267e5-9774-4568-8099-f6e0be81864f admin admin] 10.222.0.25 "DELETE /v2.0/routers/14ec93d3-21ec-4da3-9ab3-dbec95f193dd HTTP/1.1" status: 204  len: 168 time: 1.2861981
Jun 02 16:50:57.306073 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.wsgi [-] (98278) accepted ('10.222.0.25', 59140) {{(pid=98278) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:57.364566 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.db.db_base_plugin_v2 [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Deleting subnet 0374350a-1856-4ca5-89da-31ef107805e8 {{(pid=98278) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 02 16:50:57.367615 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.418887 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7196881'] for subnet, precommit_delete_associations {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.501459 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3616302'] for subnet, precommit_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.759918 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3616295', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91552', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1738106', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7264759'] for subnet, after_delete {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.763935 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-8485c478-0f2b-4331-86fc-f4742eda4457 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:57.798219 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0374350a-1856-4ca5-89da-31ef107805e8,revision_number=None']} {{(pid=98278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:57.801217 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG oslo_concurrency.lockutils [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:57.802222 dv-cinder-794021-2-iscsi neutron-server[98278]: DEBUG neutron_lib.callbacks.manager [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.809058 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e71dac0c-7bb0-4943-b347-65f41babfb2b None None] Network 3361e9cb-0a49-460c-b917-d490b80bed43 requested from dv-cinder-794021-2-iscsi {{(pid=98279) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 02 16:50:57.809624 dv-cinder-794021-2-iscsi neutron-server[98278]: INFO neutron.wsgi [None req-ec036b90-2011-403b-8dba-d42e7af48fb2 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/0374350a-1856-4ca5-89da-31ef107805e8 HTTP/1.1" status: 204  len: 168 time: 0.5022814
Jun 02 16:50:57.812200 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59142) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:57.923130 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3575261'] for network, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:57.936242 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 81617133-7b9e-4431-b711-b9f0f8b88381 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:57.986301 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: 81617133-7b9e-4431-b711-b9f0f8b88381 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:57.986612 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device 81617133-7b9e-4431-b711-b9f0f8b88381 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:57.987023 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c70570f0-64ed-4a79-a12f-1b21f13eeb3a no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:58.001913 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Deleting port d45e3628-b1d3-4203-be6b-7095cac5e353 {{(pid=98277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:58.002049 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.046711 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: c70570f0-64ed-4a79-a12f-1b21f13eeb3a {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:58.047062 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device c70570f0-64ed-4a79-a12f-1b21f13eeb3a not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:50:58.173976 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] DHCP port deletion for 3361e9cb-0a49-460c-b917-d490b80bed43 request from dv-cinder-794021-2-iscsi {{(pid=98279) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 02 16:50:58.210394 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.db [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] For port d45e3628-b1d3-4203-be6b-7095cac5e353, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d45e3628-b1d3-4203-be6b-7095cac5e353,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:58.210754 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.242952 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Deleting port d45e3628-b1d3-4203-be6b-7095cac5e353 {{(pid=98279) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 02 16:50:58.243335 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769112661854'] for port, before_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.344668 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.plugin [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Calling delete_port for d45e3628-b1d3-4203-be6b-7095cac5e353 owned by network:dhcp {{(pid=98277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:58.345352 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.db [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] For port d45e3628-b1d3-4203-be6b-7095cac5e353, host dv-cinder-794021-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-794021-2-iscsi',level=0,port_id=d45e3628-b1d3-4203-be6b-7095cac5e353,segment=NetworkSegment(9568214b-a39b-4f26-b48e-a4e73cd5ee69),segment_id=9568214b-a39b-4f26-b48e-a4e73cd5ee69)] {{(pid=98279) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 02 16:50:58.345352 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-681007'] for port, precommit_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.401669 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-11423274'] for port, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.409457 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-c26b8cb3-ca5f-4136-b50f-03d76b56dcea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:58.457991 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Pushing event deleted for resources: {'Port': ['ID=d45e3628-b1d3-4203-be6b-7095cac5e353,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:58.459757 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] No DVR routers for this DVR port d45e3628-b1d3-4203-be6b-7095cac5e353 on host dv-cinder-794021-2-iscsi {{(pid=98277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:58.461801 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:58.467721 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Calling delete_port for d45e3628-b1d3-4203-be6b-7095cac5e353 owned by network:dhcp {{(pid=98279) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 02 16:50:58.507485 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-4f82cbec-6ceb-42ce-8eb5-ed064c72b2c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.522050 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3560788', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-535850', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769112668088', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769112229367'] for port, after_delete {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.526592 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-69fb3a8d-be45-4dec-8005-60f75e621d18 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:58.568257 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Pushing event deleted for resources: {'Port': ['ID=d45e3628-b1d3-4203-be6b-7095cac5e353,revision_number=None']} {{(pid=98279) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:58.570088 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] No DVR routers for this DVR port d45e3628-b1d3-4203-be6b-7095cac5e353 on host dv-cinder-794021-2-iscsi {{(pid=98279) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 02 16:50:58.571538 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG oslo_concurrency.lockutils [None req-8c7f8b3e-a1fe-4f7b-879a-cfb542b44d92 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:58.577319 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3612823', 'neutron.services.segments.db._delete_segments_for_network-8769112582777'] for network, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.599975 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f9b776cf5b0>,) {'filters': {'network_id': ['3361e9cb-0a49-460c-b917-d490b80bed43']}} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:58.616062 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b776cf5b0>, '9568214b-a39b-4f26-b48e-a4e73cd5ee69') {'for_net_delete': True} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:58.616345 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.services.segments.db [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f9b776cf5b0>, '9568214b-a39b-4f26-b48e-a4e73cd5ee69') {} {{(pid=98277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 02 16:50:58.628241 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769112586900', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10725954'] for segment, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.644931 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470'] for segment, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.651484 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Releasing vlan 699 on physical network physnet1 to pool {{(pid=98277) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 02 16:50:58.652006 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3616470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-11423485'] for segment, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]: Traceback (most recent call last):
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     timer()
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     cb(*args, **kw)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     return func(*args, **kwargs)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     self._notify()
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     self.callback(batched_events)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     event.method(event)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     return f(self, *a, **k)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._get(url).json()
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     return self.request(url, 'GET', **kwargs)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 02 16:50:58.669458 dv-cinder-794021-2-iscsi neutron-server[98277]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 02 16:50:58.744241 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.745818 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3612832', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-694128', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-535841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683302'] for network, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.749284 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-dc8c0f8a-4e9c-4dcc-8cad-41ddb9bf012b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:58.762260 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-535900'] for network, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:58.772093 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Pushing event deleted for resources: {'Network': ['ID=3361e9cb-0a49-460c-b917-d490b80bed43,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:58.775064 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:58.778091 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-5e1e1f42-bb9a-4ab8-b704-e77b6e353c05 admin admin] 10.222.0.25 "DELETE /v2.0/networks/3361e9cb-0a49-460c-b917-d490b80bed43 HTTP/1.1" status: 204  len: 168 time: 0.9648275
Jun 02 16:50:58.905819 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59146) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:58.960743 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-8565cc69-6d76-4f4c-a542-a36fe6ea236e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b110174a94dd4df89cc6dc7b34bb7170&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0536826
Jun 02 16:50:58.963383 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59148) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:59.024438 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.050606 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.104343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.108238 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-9c5f523b-4115-4617-9604-2ff6f23641e9 tempest-AttachVolumeTestJSON-571725059 tempest-AttachVolumeTestJSON-571725059-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:59.120472 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=781601f9-3579-4401-9b5e-e634e22b43f2,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:59.123481 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:59.131974 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.133534 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-da65d141-d663-46b9-b7a1-5e6f4c749697 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/781601f9-3579-4401-9b5e-e634e22b43f2 HTTP/1.1" status: 204  len: 168 time: 0.1692240
Jun 02 16:50:59.492083 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59154) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:59.541043 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-504be499-7beb-44e9-b157-2867fcfeef68 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c649aeae15ef49fab852d41fce91f791&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0477374
Jun 02 16:50:59.544545 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [-] (98277) accepted ('10.222.0.25', 59156) {{(pid=98277) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 02 16:50:59.610124 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.636028 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.697780 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-694094'] for security_group, after_delete {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.702058 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-28920427-15e2-478c-a586-acc2c1cf2307 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 02 16:50:59.713157 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b96c2f99-d6dc-4b21-9167-2f4ea55a9879,revision_number=None']} {{(pid=98277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 02 16:50:59.720343 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG oslo_concurrency.lockutils [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 02 16:50:59.723628 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron_lib.callbacks.manager [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:50:59.724749 dv-cinder-794021-2-iscsi neutron-server[98277]: INFO neutron.wsgi [None req-2bf1cea6-ce8f-4009-9d39-c42101ca0828 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b96c2f99-d6dc-4b21-9167-2f4ea55a9879 HTTP/1.1" status: 204  len: 168 time: 0.1789758
Jun 02 16:50:59.896318 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d45e3628-b1d3-4203-be6b-7095cac5e353 no longer exists at agent ovs-agent-dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 02 16:50:59.936993 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.plugin [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] No Port match for: d45e3628-b1d3-4203-be6b-7095cac5e353 {{(pid=98279) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 02 16:50:59.937344 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron.plugins.ml2.rpc [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Device d45e3628-b1d3-4203-be6b-7095cac5e353 not bound to the agent host dv-cinder-794021-2-iscsi {{(pid=98279) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 02 16:51:00.234017 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:01.876338 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:04.525798 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:14.615780 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:51:25.798542 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-151ef9a2-ea57-420a-ba56-1646dfa4ca12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:28.502087 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-232d01e3-9236-4f6a-9626-3e19b0b0db12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:28.740091 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:30.244158 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:31.880034 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:34.532730 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:51.608538 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:51:55.795254 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-89be8a9c-c7ca-4bb3-8d9d-4b8f6223e48a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:58.517959 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-2c2f2605-13a3-4d1c-aa69-359cc188e55d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:51:58.746333 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:00.247668 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:01.885275 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:04.539678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:25.790161 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-3c38f672-263e-4598-af4e-67fafce16938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:28.519609 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ed85b87a-cdf5-4bed-a2f8-f5cdbb97349d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:28.613779 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:52:28.750650 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:30.244560 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:31.885295 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:34.539041 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:55.794713 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-683571e4-ada1-407a-9834-2aa14f21a9b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:58.517382 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-39c5afcf-c9a3-4c16-9dc0-58e873024d39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:52:58.761844 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:00.246813 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:01.890176 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:04.542540 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:05.614822 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:53:25.801334 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9ff41067-734f-4fdd-aa86-1569440b5cb7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:28.512369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-11b2b46b-9e81-4ac6-a5f8-b68da638f551 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:28.755863 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:30.249656 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:31.890173 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:34.536809 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:42.613849 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:53:55.800135 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8339ec0e-54ed-43f8-902e-67d46218387d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:58.519584 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-d8c00748-0d39-44b2-8cfc-f4b707ccbc19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:53:58.761369 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:00.252092 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:01.895520 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:04.542401 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:19.612919 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:54:25.802742 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-99083c85-b87e-4c0c-b614-367dbfa94f67 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:28.514894 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-9b7053ff-1bac-4987-a6ee-28d374809fcc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:28.770100 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:30.257211 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:31.896644 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:34.589496 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:55.797545 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8a7d17b2-b07f-4b82-bc8c-4a10891289cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:56.612454 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:54:58.512147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-a855b9dd-9071-41fa-8774-0a0d2ca95287 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:54:58.770282 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:00.259852 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:01.900688 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:04.568201 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:10.766883 dv-cinder-794021-2-iscsi neutron-server[98277]: DEBUG neutron.wsgi [req-5f59f625-a793-4efc-af88-343b9a90ae3f req-d12b7a77-5b71-4b17-ab85-84628c64caa7 service neutron] (98277) timed out ('10.222.0.20', 50709) {{(pid=98277) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 02 16:55:25.807469 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d6d4429-b971-45b8-9dc1-e6c726926d0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:28.516608 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-bcda3e85-61c2-418a-bb27-dac7866fc667 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:28.768619 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:30.261513 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:31.908678 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:33.612274 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 02 16:55:34.564723 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:55.803125 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-e25cac04-6c93-4f8c-9bcf-7ee1fd1632d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:58.515734 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-df65015c-b563-40bd-9a3b-736c4a319210 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:55:58.773539 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-ba50a2a7-a1de-4184-8877-6931ca36ae3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:56:00.265147 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-8d71f524-1a04-4b06-b764-ce3c17439ce8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:56:01.909464 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-50836fa4-352b-45dc-a1c9-911e6b230966 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:56:04.580041 dv-cinder-794021-2-iscsi neutron-server[98279]: DEBUG neutron_lib.callbacks.manager [None req-97798718-42b0-4a3e-a851-86b3cf5921cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769112702877', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3611651'] for agent, after_update {{(pid=98279) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 02 16:56:10.612943 dv-cinder-794021-2-iscsi neutron-server[98280]: DEBUG neutron.db.agents_db [None req-0e9a080f-3ebd-47e9-82c9-29e321c618f5 None None] Agent healthcheck: found 6 active agents {{(pid=98280) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}